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HOW IMPORTANT IS YOUR DATA? 


Years of family photos. Your entire music 
and movie collection. Office documents 
you've put hours of work into. Backups for 
every computer you own. We ask again, how 
important is your data? 


NOW IMAGINE LOSING IT ALL 


Losing one bit - that’s all it takes. One single bit, and 
your file is gone. 


The worst part? You won’t know until you 
absolutely need that file again. Example of one-bit corruption 


THE SOLUTION 


The FreeNAS Mini has emerged as the clear choice to The Mini boasts these state-of-the- 
Save your digital life. No other NAS in its class offers art features: 
ECC (error correcting code) memory and ZFS bitrot 


protection to ensure data always reaches disk # B-core 2 AGHZ Inter ALM ™ PIOCessor 
‘ ; : - Up to 16TB of storage capacity 
without corruption and never degrades over time. 


- 16GB of ECC memory (with the option to upgrade 


to 32GB) 
No other NAS combines the inherent data integrity - 2x 1 Gigabit network controllers 
. . ~R IPMI 
and security of the ZFS filesystem with fast on-disk Sn uacieaaam eel 
¢ Tool-less design; hot swappable drive trays 
encryption. No other NAS provides comparable power » FreeNAS installed and configured 


and flexibility. The FreeNAS Mini is, hands-down, the 
best home and small office storage appliance you can 
buy on the market. When it comes to saving your 
important data, there simply is no other solution. 
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FREENAS 


CERTIFIED 
STORAGE 


With over six million downloads, 
FreeNAS is undisputedly the most 
popular storage operating system 
In the world. 


Sure, you could build your own FreeNAS system: 
research every hardware option, order all the 

parts, wait for everything to ship and arrive, vent at 
customer service because it hasn‘t, and finally build it 
yourself while hoping everything fits - only to install 
the software and discover that the system you spent 
days agonizing over isn’t even compatible. Or... 


MAKE IT EASY ON YOURSELF 


As the sponsors and lead developers of the FreeNAS 
project, ixsystems has combined over 20 years of 
hardware experience with our FreeNAS expertise to 
bring you FreeNAS Certified Storage. We make it 
easy to enjoy all the benefits of FreeNAS without 
the headache of building, setting up, configuring, 
and supporting it yourself. As one of the leaders in 
the storage industry, you know that you're getting the 
best combination of hardware designed for optimal 
performance with FreeNAS. 


Every FreeNAS server we ship is... 


» Custom built and optimized for your use case 

» Installed, configured, tested, and guaranteed to work out 
of the box 

» Supported by the Silicon Valley team that designed and 
built it 

» Backed by a 3 years parts and labor limited warranty 


http://www.iXsystems.com/storage/freenas-certified-storage/ 


As one of the leaders in the storage industry, you 
know that you're getting the best combination 

of hardware designed for optimal performance 

with FreeNAS. Contact us today for a FREE Risk 
Elimination Consultation with one of our FreeNAS 
experts. Remember, every purchase directly supports 
the FreeNAS project so we can continue adding 
features and improvements to the software for years 
to come. And really - why would you buy a FreeNAS 
server from anyone else? 


Settings 


FreeNAS 1U 
- Intel® Xeon® Processor E3-1200v2 Family 
Up to 16TB of storage capacity 
16GB ECC memory (upgradable to 32GB) 
2 x 10/100/1000 Gigabit Ethernet controllers 
Redundant power supply 


FreeNAS 2U 


- 2x Intel® Xeon® Processors E5-2600v2 Family 


- Up to 48TB of storage capacity 

¢ 32GB ECC memory (upgradable to 128GB) 

¢ 4x 1GbE Network interface (Onboard) - 
(Upgradable to 2 x 10 Gigabit Interface) 

« Redundant Power Supply 
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MAGAZINE 


Editor's Word 


Dear Readers, 


And we meet again. | hope that all of you are doing well, and enjoying your holidays. | also hope that you’ve missed us, 
and therefore you have allocated some time to read the new BSD issue. This time, we, the BSD reviewers’ team, the 
authors and | want to present a few good readings. | am convinced you will find them very interesting. 


This issue includes the article on Overriding LIBC Functions To Do Constructive Things, written by Rafael Santiago de 
Souza Netto. In his article, Rafael will introduce you to the main aspects of function override techniques in the C library 
from userspace. He will mainly focus on doing constructive things with function overrides, particularly in getting the most 
out of your system to solve problems. The next article that we included is written by Abdorrahman Homaei. He will tell 
you more about FreeBSD Desktop Environments and about Xfce, Xfce Pros and Cons. He goes further to describe what 
SLIM, iSlock are, and he teaches you how to Install Xfce, SLIM, and iSlock. 


lf you want more how-to articles, be ready to read the article written by Teppei Fukuda and Kota Kanbe entitled 
Automating Vulnerability Scanning with Vuls. They will introduce to you to Vuls (https://github.com/future-architect/vuls), 
an open-source vulnerability scanner for Linux/FreeBSD, which is agentless and written in Go. Vuls tells you which 
servers and software are related to the newly disclosed vulnerabilities. This leads us to the security topic. In my opnion, 
security is an important topic nowadays which is hard not to share some insights on it. In this issue of the BSD 
magazine, you will also get a chance to read the article, Your Information Is Out There Ready to Be Bought, authored by 
Jacob Alexander. He encourages you to read his article as a lesson about your security and of course, do your own 
research before hopping on the crazy train. At least you will know that all he wrote was based on facts, and your 
information is out there ready to be bought. 


In this issue, you can continue reading about TrueNAS X10. Steve Wong, in this second part, will discuss four of the 
many use cases supported by the IrueNASX10. This is to help organizations work more effectively and efficiently, and to 
provide the rationale on why the X10 may be perfectly aligned with their IT environment. 


For those who want to learn more about Unix, we have the article on Processing Data in Parallel Using Multithreading by 
Mark Sitkowski C.Eng, M.I.E.E Cybersecurity Consultant. Here are a few words from the abstract just to entice you to 
read the full text: Real life being what it is, despite the isolation provided by the partitioned stack, the situation can still 
arise, where we might need to prevent more than one thread from executing a given function, or other block of code. For 
instance, we may be in the process of assembling a linked list, and it would be counter-productive to have two threads 
adding an element to the end of the list at the same time. 


At the end, please read the /nterview with David Mytton to find out why and how he built his first product to have a 
simple way to get metrics and alerts from his servers. 


SO, let’s read!!! And have a fun on our holidays! 
Best regards, 
Ewa & The BSD Team 
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In this second part, Steve is going to discuss four of the 
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help organizations not only work more effectively and 
efficiently, but to provide the rationale on why the X10 
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FreeBSD Desktop with Xfce, SLIM and iSlock 14 
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Many people are looking for lightweight, fast and stable 
desktop environments. However, a fully functional how-to 
is hard to come by. In this article, a functional how-to 
consists of three elements which include: desktop 
environments, desktop manager (login manager), and 
desktop locker. 
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This article will introduce the reader to the main aspects 
of function override techniques in the C library from 
userspace. Most of the existing material on this topic 
focuses on malicious uses of function overriding in 
malware. In this article, however, we will focus on doing 
constructive things with function overrides, particularly in 
getting the most of your system to solve problems. 


SECURITY 


Automating Vulnerability Scanning with Vuls 30 
Teppei Fukuda and Kota Kanbe 

We will introduce to you Vuls 
(https://github.com/future-architect/vuls), an 
open-source vulnerability scanner for Linux/FreeBSD, 
agentless, and written in Go. Vuls tells you which servers 
and software are related to the newly disclosed 
vulnerabilities. Vuls uses multiple detection methods 
including changelog, Package Manager, NVD, and OVAL, 


and it is possible to scan many servers at high speed by 
using the parallel processing in Go language. 


Your Information Is Out There Ready to Be Bought 38 
Jacob Alexander 

Even if you pay all your bills in cash, never sign up for an 
online account or never even open a web browser. 
Websites still know you very well because they can share 
information with brick and mortar businesses. Most 
people don’t tend to think about these things and just 
give websites or businesses everything that they ask for. 
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Using Multithreading 42 
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Real life being what it is, despite the isolation provided 
by the partitioned stack, the situation can still arise, 
where we might need to prevent more than one thread 
from executing a given function, or other block of code. 
For instance, we may be in the process of assembling a 
linked list, and it would be counter-productive to have 
two threads adding an element to the end of the list at 
the same time. 
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Interview with David Mytton 46 
Ewa Dudzic 

I’m the Co-Founder & CEO at Server Density. Having 
built the original version of the product, | used to do a lot 
of coding but nowadays, | soend most of my time with 
the overall management of the business in financial 
planning, product strategy, technical and architectural 
oversight, commercial engagement with prospects and 
customers, hiring, PR & marketing and board or investor 
relations. 


COLUMN 


The recent tragedy and fire at Grenfell Tower in 
London that claimed more than 80 lives may seem as 
far from IT and technology as it is possible to 
imagine. But to the engineering mind, it highlights the 
ongoing specter of systemic failure and risk, where 
cascading error culminates in a disaster 50 
Rob Somerville 


FreeBSD 11.1 Released 


The FreeBSD Release Engineering Team is pleased to 
announce the availability of FreeBSD 11.1-RELEASE. 
This is the second release of the stable/11 branch. 


some of the highlights: 


¢« Clang, LLVM, LLD, LLDB, and libc++ have been 
updated to version 4.0.0. 


« Many third-party (contributed) software updates, such 
as the Elf Tool Chain, ACPICA, libarchive(3), ntpd(8), 
unbound(8), and more. 


¢« Support for blacklistd(8) has been added to OpenSSH. 


- The zfsbootcfg(8) utility has been added, providing 
one-time boot.config(5)-style options for zfsboot(8). 


- The efivar(8) utility has been added, providing an 
interface to manage UEFI variables. 


« Support for Microsoft® Hyper-V™ Generation 2 virtual 
machines has been added. 


- The ena(4) driver has been added, providing support 
for "next generation" Enhanced Networking on the 
Amazon® EC2™ platform. 


¢« The NFS client now supports the Amazon® Elastic File 
System™ (EFS). 


« The EFI loader can now access remote files via TFTP 
in addition to NFS as a runtime configuration option. 


- ZFS now stores compressed data in cache, improving 
cache hit rates and performance. 


¢ Several updates to provide build reproducibility. 


IN BRIEF 


For more information about FreeBSD release, please 
visit: 
https://www.freebsd.org/releases/11.1R/announce.html 


#ServerEnvy: TrueNAS X10 


The TrueNAS X10 is the 3rd generation of the TrueNAS 
unified storage line. 


The X10 is the first of a new TrueNAS series, and will be 
expandable to up to 360TB with the TrueNAS ES12 
expansion shelf. 


This blog will show what makes the TrueNAS X10 unique. 


Those looking for unified, highly available (HA), reliable 
enterprise grade storage with a self-healing file system 
will find that the TrueNAS X10 fits their business needs, 
at an economical price point. 


Many businesses have ended up purchasing storage that 
far exceeded their requirements, or opted to purchase 
less reliable storage due to budget constraints. Many 
legacy storage vendors use 5-10 year old technology. 


The TrueNAS X10 represents the birth of a new type of 
storage array and is ideal for businesses with RoBos 
(remote office / branch office) and enterprise workloads 
such as backup, replication, file sharing, and other 
applications. 


The X10 is cost effective, retailing at a 30% lower price 
point than the Z20, making it an effective addition to your 
backup/DR infrastructure. The street price of a 20TB 
non-HA model falls under $10K. It’s designed to move 
with six predefined configurations that match common 
use cases. 


The dual controllers for high availability are an optional 
upgrade to ensure business continuity and avoid 
downtime. 


The X10 boasts of a 36 hot swap SAS using two 
expansion shelves, for up to 360TB of storage, allowing 
you to backup thousands of VMs or share tens of 


thousands of files. One of the use cases for TrueNAS X10 
is for backup, SO users can upgrade the X10 to two ports 
of blazing 10GigE connectivity. The 20TB non-HA model 
enables you to backup over 7,000 VDI VMs for under 
$3.00 per VM. 


Overall, the X10 is a greener solution than the TrueNAS Z 
product line, with the non-HA version boasting of only 
138 watts of power and taking up only 2U of space. 
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Don’t forget in-line compression, deduplication, unified 
file and block sharing, flash-assisted read & writing 
caching and its self-healing file system. 


The X10 also features non-disruptive software upgrades, 
snapshots, clones, replication, thin provisioning, online 
Capacity expansion, RAID protection, and the list goes 
on. 


Best of all, the TrueNAS X10 starts at $5,500 street. You 
can purchase a 1201TB configuration today for under 
$20K street. 


The TrueNAS product line has customers ranging from 
the media and entertainment, government, to education 
industries. 


You can learn more about the X10 through our official 
press release or read Steve’s blog on the technical 
merits. 


Source: 
https://www.ixsystems.com/blog/serverenvy-truenas-x10/ 


DigitalOcean Releases Block 
Storage, Enabling Developers 
and Businesses to Build and 
Scale Larger Applications 


Highly available and flexible SSD-based storage enables 
teams of developers to scale production workloads, add 
disk space, and build distributed applications without 
changing Droplet size 


DigitalOcean, the provider of cloud computing platform 
designed for developers, today released Block Storage, 
the number one product request from customers. Block 
Storage is a highly available and scalable SSD-based 
offering that will enable developers to easily attach extra 
disk space to DigitalOcean Droplets (cloud servers). 
DigitalOcean's Block Storage costs $0.10/GB per month 
and is based on provisioned capacity only, therefore 
there is no need for complicated formulas to determine 
the overall cost for transactions or IOPs limit. 


DigitalOcean was founded in 2011 with the mission to 
simplify the complexities of infrastructure by offering one 
simple and robust platform for developers to launch and 
scale their applications easily. The company has taken a 
"developer first" mentality and is now evolving its 
platform to further support the business needs of the 
developer. According to Netcraft, DigitalOcean has 
become the second largest and fastest growing cloud 
computing platform in the total number of public facing 
apps and websites. More than 700,000 registered 
customers have launched more than 18 million Droplets 
combined on DigitalOcean, nearly doubling from 10 
million six months ago. 


"We set out on a mission to build a simple and robust 
cloud computing platform so that engineering teams can 
spend less time configuring and automating their 
infrastructure and more time focused on software 
development," said Ben Uretsky, co-founder and CEO, 
DigitalOcean. "By adding a highly performant Block 
Storage offering to our platform, developers can easily 
deploy and manage their SaaS applications and 
businesses as they scale. This is one step closer to 
building the next generation platform." 


The Easiest Way for Developers to Attach and Scale 
Storage to Support Their Businesses and Applications 


Block Storage is a complementary product to 
DigitalOcean's Droplets, which provide compute power 


and local storage, by making them more expandable and 
flexible. By attaching Block Storage to DigitalOcean 
Droplets via the control panel or API, developers can 
achieve the following benefits: 


¢ High Availability: Block Storage stores data on 
hardware that is separated from the Droplet, replicating 
it multiple times across different racks and reducing 
the chances of data loss in the event of hardware 
failure. 


¢ Scalable and Flexible: Developers can easily scale and 
resize SSD-based Block Storage volumes from 1GB to 
161TB and move it between Droplets. The ability to 
attach extra Block Storage to Droplets dramatically 
increases their flexibility, enabling developers to scale 
applications, databases, binary assets, shared and 
distributed filesystems and more. 


¢ Reliable and Secure: All the data is encrypted at rest 
and transmitted to the Droplets over isolated networks. 


Supporting Quotes 


« GitLab developer Patricio Cano said: "Storage is a very 
real challenge for big teams or teams that work with 
lots of data. Storing assets will always take a lot of 
space which usually forces people to prioritize what 
they want to store or spend increasingly more money 
for each additional unit of storage. Using GitLab's 
GitHost as an example, without Block Storage, the 
amount of disk space an instance has is tied together 
with the plan the customer selects. With Block 
Storage, customers can now choose the right plan 
based on their team's needs (amount of RAM and 
processors) without having to worry about limited disk 
space, because they can now add up to 161B of extra 
storage. For GitLab and our customers this is great 
news. We're excited to see how Block Storage in 
conjunction with Git LFS will enable users to easily 
store and version control their files." 


- Mesosphere Co-founder and Chief Architect Benjamin 
Hindman said: "Developers across all platforms want 
simple, high-performance cloud storage like what 
DigitalOcean offers with its new Block Storage service. 
We're excited to work with DigitalOcean as part of the 
open source DC/OS storage interest group, in an effort 
make Block Storage available for DC/OS users, and to 
improve the overall storage experience for 
developers." 


Additional Resources 


« Read the blog on Block Storage: 


https://www.digitalocean.com/company/blog/block-st 
orage-more-space-to-scale 


« Read the tutorial on how to use Block Storage: 


https://www.digitalocean.com/community/tutorials/ho 
w-to-use-block-storage-on-digitalocean 


Source: 


https://www.digitalocean.com/company/press/releases/d 


igitalocean-releases-block-storage/ 


pfSense 2.3.4-p1 RELEASE 
Available! 


ofSense software version 2.3.4-p1 is now available! This 
is a maintenance/errata patch available by running an 
update from an existing installation and it does not have 
a standalone installer to download. Version 2.3.4-p1 
includes security fixes in pfSense and in underlying 
software, such as OpenVPN, and other bug fixes. 
ofSense software version 2.3.4-p1 includes updates for 
OpenVPN mentioned in an earlier blog post. Updating to 
2.3.4-p1 will update OpenVPN automatically without any 
extra intervention. The firewall will reboot after applying 
the update. 


pfSense software is Open Source 


For those who wish to review the source code in full 
detail, the changes are all publicly available in three 
repositories on Github: 


Main repository - the web GUI, back end configuration 
code, and build tools. 


FreeBSD source - the source code, with patches of the 
FreeBSD 10.3 base. 


FreeBSD ports - the FreeBSD ports used. 


Source: 


https://www.netgate.com/blog/pfsense-2-3-4-p1 -release 
-now-available.html 


Relayd and Httpd Mastery 
by Michael W Lucas 


“| think we’re gonna need a bigger web server.” 
OpenBSD has a solid reputation for security and stability. 
It’s well known for the OpenSMTPd mail server, the 
LibreSSL cryptography library, and the PF packet filter. 
But nobody ever talks about the load balancer, or the 
web server, until now. 


The httpd web server provides a fast, stable, secure 
environment for your web applications. The relayd load 
balancer lets you distribute Internet application load 
across multiple hosts. Between the two, you can slash 
hundreds of thousands of dollars off the cost of building, 
deploying, and managing applications. 

With Httod and Relayd Mastery you’ll learn how to: 


set up websites 

configure software to run in a chroot 

run dozens or hundreds of sites on one host 
dynamically reconfigure sites with Lua patterns 
manage site logs 

maintain free, globally-valid SSL certificates 
improve performance with SSL stapling 

install and maintain two-server clusters 
distribute traffic between any number of hosts 


stop worrying about old SSL versions and bad 
crypto algorithms 


Slash the amount of time you spend futzing with web 
servers. Get Httpd and Relayd Mastery today! 


Source: https://www.createspace.com/7/1 77283 


TRUENAS 


Introducing The TrueNAS 
Unified Storage X10. 
Part 2 


Steve Wong, Director of Storage Product Management 


Steve Wong is the director of product management at iXsystems. He is a senior level professional with 
over 20 years of experience in the fields of data communications, enterprise storage, networking, 
telecommunications, brand marketing, publishing, e-commerce and consumer package goods. Before 
iXsystems, Wong worked at Seriallek, Hitachi Data Systems, ClearSight Networks, Finisar, Anritsu and 
Mattel. 


He began his career in investment banking at Bear Stearns, and then served as a member of technical 
Staff at AT&T Bell Laboratories. Wong holds a BA from New York University and an MBA from the 
Kellogg Graduate School of Management, Northwestern University. 


Four Use Cases for the TrueNAS X10 


In this second part, | am going to discuss four of the many use cases supported by the IrueNASX10. This is to help 
organizations work more effectively and efficiently, and to provide the rationale on why the X10 may be perfectly aligned 
with their IT environment. 


lf you read part one of this blog on the TrueNAS X10 which was published a couple of weeks ago, you will recall that it 
focused mainly on the technical aspects of this new iXsystems platform. If you did not get a chance to read it, | highly 
recommend you do so now, and then return to this blog. 
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File Serving 


In organizations, small or large, there is a requirement to deliver reliable and continuous data access to users and 
applications through a wide variety of protocols. The X10 is designed to be a high performance general purpose filer, 
providing users with simultaneous file data access critical for the successful performance of their business and work 
tasks. The X10 platform supports all the common file protocols including NFS, SMB and AFP. This means that if your 
organization has Linux or Unix desktops, the X10 has got you covered. If your users connect via a Windows computer, 
you are covered as well. 


Even Apple systems can connect to data storage resources through AFP. iSCSI block access is also available for 
platforms such as Windows, VMware and various backup solutions. 


Standard directory services such as Active Directory, NIS, Open Directory, and LDAP, support authentication and 
network resource services within multi-OS environments. Administrators can prevent users and specific user groups 
from consuming vast amounts of storage through the quota facility. Additionally, there is a myriad of data protection 
services available to safeguard data. For example, if a user inadvertently deletes some important files, these files can be 
restored within a matter of minutes. 


The X10 runs TrueNAS and supports a High Availability option to ensure data access is continuously available. Users and 
applications can expect uptimes of 99.999%, meeting or exceeding even the most rigorous of service level agreements. 


Disaster Recovery (DR) 


For local data protection, many storage administrators rely on snapshots. The TrueNAS operating system is unique in 
that, snapshots happen nearly instantaneously and take up little to no space, so you can take many snapshots per hour 
without worrying about exhausting a snapshot pool. Also, TrueNAS does not impose any restrictions on how many 
snapshots can be taken. 


My general advice to customers has been to take and keep as many snapshots as you can manage. Michael Dexter, a 
colleague of mine, recently wrote about how the snapshotting capability of TrueNAS can help you recover if you find 
yourself infected with a ransomware virus. 


Remote replication is the process of copying or replicating data to another device, typically at a different location. A 
source system located in San Jose, California can replicate data to a secondary system located in Evanston, Illinois. 
Should some unforeseen disaster occur to the source system, the secondary system will have a complete backup of the 
data, allowing the business to quickly restore their business operations. 


A TrueNAS X10 can replicate data to another TrueNAS system or any other OpenZFS-based system. TrueNAS replication 
uses snapshot-based technology. After the initial baseline replication from a source to a target, only “changes” are 
replicated afterwards. This greatly decreases the size of the backup window, and results in lower associated network 
cost because less bandwidth is consumed. 


Cloud sync is a new capability that was introduced earlier this year by iXsystems. This is a TrueNAS built-in software 
feature that allows an administrator to use the Amazon S3 storage as a backup target. Specified data sets on a TrueNAS 
X10 can be replicated to an S3 cloud. Should something catastrophic occur, data can be restored from the S3 cloud 
back to a TrueNAS appliance. The Amazon S3 storage cloud is both resilient and persistent. 


The cloud provider reports that the S3 is designed to provide 99.999999999% (11 9s if you are counting) durability of 
objects over any given year. This means that for every 10,000 objects that are stored, one object will be lost every 10,000 
years — on average. In realistic terms, the odds of data loss occurring on the Amazon S3 are astronomically small. 


There is even a use case for group collaboration and file sharing using the Cloud sync feature where file data can be 
shared amongst geographically dispersed teams and groups working on the same projects (See graphic below). 
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FACILITATE COLLABORATION WITH CLOUD SYNC 


Using the TrueNAS 
Cloud Sync feature, 
the same file data 
can be uploaded up 
to (or downloaded 
from) the Amazon 
S3 storage cloud 
from multiple 
sources, facilitating 
the data sharing and 
allowing for team 
collaboration. 


Even users without a TrueNAS can 
access and modify file data on the 
S53 (uploaded there by a TrueNAS) 
using a browser or through the S3 
REST API and reshared that data 
with TrueNAS users 


Backups 


The TrueNAS X10 is designed to keep TBs of backup images. Its low cost per GB, in-line compression, and support of 
up to 360TB of raw capacity helps to improve ROI and makes the X10 a cost-effective platform for use as a replication 
and/or backup/archiving target. 


Additionally, the OpenZFS file system was designed for data integrity and can self-heal itself, which keeps backup 
images safe. File system integrity is verified with checksums and if inconsistencies are found, those inconsistencies can 
be repaired automatically. 


Edge to Core Applications 


Many organizations have satellite or remote offices, sometimes called RoBos. These facilities often maintain and manage 
their IT infrastructure and run local services. The challenge for many of these organizations is how to equip their smaller 
environments with enterprise-ready storage solutions without having to compromise on a consumer-class solution. 


A fully configured TrueNAS X10 with 20TB of enterprise storage starts at less than $10,000 (street pricing), striking the 
ideal balance between cost and capabilities. And as discussed in the DR section, data from a TrueNAS X10 appliance at 
a corporate satellite office can be replicated back to another TrueNAS at the corporate data center. 


We discussed four use cases where the TrueNAS X10 excels. Businesses looking for a cost-efficient, fully 
enterprise-ready storage solution which supports a variety of use cases and aligns with their budgetary requirements 
should take a closer look at the TrueNAS X10. 
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FREEBSD 


FreeBSD Desktop with Xfce, 
SLIM and islock 


Introduction 


Many people are looking for lightweight, fast and stable 
desktop environments. 


However, a fully functional how-to is hard to come by. 


In this article, a functional how-to consists of three 
elements which include: 


Desktop environments. 
Desktop manager (login manager). 


Desktop locker. 
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What you will learn... 


FreeBSD Desktop Environments 
More about Xfce Pros and Cons 
What is SLIM? 

What is iS8lock? 

How to Install Xfce? 

How to Install SLiM 

How to Install iSlock? 

Test All Together 


FreeBSD Desktop Environments 


A desktop environment typically consists of icons, 
windows, toolbars, folders, wallpapers and desktop 
widgets. 


A desktop environment aims to be an intuitive way for the 
user to interact with the computer using concepts which 
are similar to those used when interacting with the 
physical world, such as buttons and windows. 


They are many, but the four commonly used desktop 
environments include: 


GNOM 


GNOME is a user-friendly desktop environment. It 
includes a panel for starting applications and displaying 


status, a desktop, a set of tools and applications. 
Moreover, GNOME has a set of conventions that make it 
easy for applications to cooperate and be consistent with 
each other. 


KDE 


KDE is another easy-to-use desktop environment. This 
desktop provides a suite of applications with a consistent 
look and feel, a standardized menu and toolbars, 
keybindings, color-schemes, internationalization, and a 
centralized, dialog-driven desktop configuration. 


Mate 


MATE is a desktop environment forked from the 
now-unmaintained code base of GNOME 2. 


Mate is lightweight, but it is not stable at all. 
Xfce 


Xfce is a fast, light, and efficient desktop environment 
based on the GITK+ toolkit used by GNOME. When 
compared to other environments, it is more lightweight 
and provides a simple, efficient, easy-to-use desktop. 
Moreover, it is fully configurable, has a main panel with 
menus, applets, and application launchers. It provides a 
file manager and sound manager, and is themeable. 


More about Xfce 


Xfce is a free and open-source desktop environment for 
Unix and Unix-like operating systems such as Linux, 
Solaris, and BSD. 


Xfce aims to be a fast and lightweight desktop 
environment while maintaining its visually appealing and 


easy to use attributes. Xfce embodies the traditional UNIX 


philosophy of modularity and reusability. It consists of 
separately packaged parts that together provide all 
functions of the desktop environment. 


Xfce Pros and Cons 

Pros: 
- Xfce is easy to install. 
- Xfce is lightweight. 


- Xfce is minimal but you can add what you 
want. 
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¢ Xfce is stable. 


¢« Xfce code is clean. 


Cons: 

- There is no display manager. 

« It doesn't have a desktop locker. 
What Is SLIM’? 


Simple Login Manager (SLiM) is a graphical display 
manager for the X Window System that can be run 
independently of any window manager or desktop 
environment. SLIM aims to be a light, completely 
configurable that is suitable for machines on which 
remote login functionalities are not required. 


SIIM can be used as Xfce display manager and it’s fully 
compatible with Xfce. 


What Is iSlock? 


i3lock is a simple screen locker like slock. After starting it, 
you will see a white screen (you can configure the 
color/an image). You can return to your screen by 
entering your password. 


Features: 


i3lock forks, So you can combine it with an alias to 
suspend RAM (run "i3lock && echo mem > 
/sys/power/state" to get a locked screen after waking up 
your computer from suspend to RAM) 


You can specify either a background color ora PNG 
image which will be displayed while your screen is locked. 


You can specify whether i3lock should bell upon a wrong 
password. 


i3lock uses PAM, and therefore, it is compatible with 
LDAP, etc. 


How To Install Xfce? 
To install the Xfce package: 

# pkg install xfce 
Alternatively, to build the port: 


# Cd /usr/ports/xll—wm/xitce4 


+ make onete ll clean 


Unlike GNOME or KDE, Xfce does not provide its login 


manager to start SIIM login manager, add its entry to 
~/.xinitre: 


 BCno “Exec /iusr/ 1 oGal/ bin startcxrced 


—--with-ck-launch" > ~/.xinitre 


How To Install SLIM? 


In order to install SIiM, issue the following commands: 


# pkg install slim 

Add these lines to /etc/rc.conf to load SIiM at boot: 
GDuUs:. eieble="1Es” 

ie. bo. Snag Le="YEho. 


Slim, enable="iEo. 


Alternatively, you can issue the following commands: 


# sysrc dbus enable="YES" 
# sysrc hald enable="YES" 


# sysrc slim enable="YES" 


How To Install iSlock? 


i3lock installation is very easy: 


# pkg install i3lock 


For more information about i3lock, please issue this 
command: 


+ “Te: 3-3.OC Kk 


Test All Together 


Reboot your machine to check if it works: 


# reboot 


After a while, you will see the SIIM login manager: 
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Now you can enter your Username and Password to login 


to Xfce desktop. 


To test i3lock , you have to open a terminal from Xfce 
menu and issue the following commands: 


# i3lock 


=’% Keyboard 


Keyboard 


L_%_J 


Behayior Application Shortcuts Layout: 


Define shortcuts for launching applications: 


Command 

exo-open --launch MailReader 
exo-open --launch WebGrowser 
iZlock 

xfce4-appfinder 

xfce4-appfinder --collapsed 
xfce4-display-settings --minimal 
xfce4-display-settings --minimal 
xice4-popup-applicabonsmenu 
xfgesktop «menu 

xflock4 


# Add / Edit 


= Remove 


Help 


Edit keyboard settings and application shortcuts 


Shortcut 
XF86Mail 
XFaGWWW 
Super +L 
AN+F3 
Alt+F2 
Super +P 
AF SB6Desplay 
Alt+F1 
Ctri+Escape 
Ctri+Alt+Delete 


»? Reset to Defaults 


3¢ Close 


BSD Certification 


Also, you can add idlock to Xfce shortcuts. 


As you can see, super+L(windows+L) will lock my 
desktop. 


Conclusion The BSD Certification Group Inc. 
| | | (BSDCG) is a non-profit organization 
Xfce is a blazingly fast and stable environment platform, itted t ti d 
and there are much functionality you can add to your committed to crea ng an 
desktop. maintaining a global certification 
standard for system administration 
on BSD based operating systems. 


@ WHAT CERTIFICATIONS ARE AVAILABLE? 


BSDA: Entry-level certification suited for candidates 
Useful Links with a general Unix background and at least six months of 

experience with BSD systems. 

http://meetbsd.ir 

. BSDP: Advanced certification for senior system administrators 

iufobiilneaetsteLetelan with at least three years of experience on BSD systems. 
Successful BSDP candidates are able to demonstrate 
strong to expert skills in BSD Unix system administration. 


© WHERE CAN | GET CERTIFIED? 


We're pleased to announce that after 7 months of 


About the Author negotiations and the work required to make the exam 
available in a computer based format, that the BSDA 
Abdorrahman Homaei has been working as a exam is now available at several hundred testing centers 
software developer since 2000. He has used around the world. Paper based BSDA exams cost $75 USD. 
FreeBSD for more than ten years. Computer based BSDA exams cost $150 USD. The price of 


the BSDP exams are yet to be determined. 


He became involved with the meetBSD dot ir 


and performed serious training on FreeBSD. Payments are made through our registration website: 
https://register.bsdcertification.org//register/payment 


company in Feb 2017. 
a) WHERE CAN | GET MORE INFORMATION? 


You can visit his site to 
view his CV: 


http://in4bsd.com 


He is starting his own uj 
| 


More information and links to our mailing lists, Linkedin 
groups, and Facebook group are available at our website: 
http://www.bsdcertification.org 


Registration for upcoming exam events is available at our 
registration website: 
https://register.bsdcertification.org//register/get-a-bsdcq-id 


FREEBSD 


Overriding LIBC 


Functions fo Do 


Constructive Things 


This article will introduce the reader to the main aspects 
of function override techniques in the C library from 
userspace. Most of the existing material on this topic 
focuses on malicious uses of function overriding in 
malware. In this article, however, we will focus on doing 
constructive things with function overrides, particularly in 
getting the most of your system to solve problems. A 
basic knowledge of C will be necessary for following the 
text. 


What is function overriding? 


Function overriding is a technique that allows you replace 
some function code with another one. Usually, the new 
function will call the old one at some point in its execution. 
This is also Known as “hooking’. As you can see, it can be 
a doorway to abyss, if you think about the countless nasty 
things that this technique could make possible. Indeed, 
many rootkits use this idea in some way. There are 
multiple ways of overriding a function. Here, we will focus 
on overriding a function during the linking phase in user 
mode. 
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You will see that even though function overrides are used 
by rootkits and other malware, the general technique can 
serve useful purposes and should not be demonized. 


What are the main phases of a 
compiling process? 


some years ago, knowledge of the compilation process 
could be assumed. However, nowadays with tons of 
high-level interpreted languages, many new developers 
are not exposed to and are thus not familiar with 
compilation. Because of this, we will briefly discuss it 
here. 


According to Aho, Sethi and Ullman, in their definitive text 
on compilers known as the “Dragon Book”, a compiler 
can be divided into six phases: lexical analyzer, syntax 
analyzer, semantic analyzer, intermediate analyzer, 
intermediate code generator, code optimizer and code 
generator. Output from each phase feeds the next one. All 
phases can access the symbol table generated from the 


Original source code and also can trigger errors. If an 
error occurs, it typically, aborts the whole process. 


At a higher level, a typical language-processing system is 
made up of four main parts: preprocessor, compiler 
(covered in the previous paragraph), assembler, and 
loader/link-editor. Linking obviously occurs inside the last 
component. 


As you can see, the language-processing system 
described in the Dragon Book is pretty close to the C 
compilation paradigm that C programmers are familiar 
with. 


The preprocessor will handle the macros, the compiler 
will check and produce target assembly code, and the 
assembler will generate object files. The linker/loader will 
replace the relocatable codes by absolute machine code. 


Relocatable codes are great 


When you start a process on your system, all addresses 
referenced by this process have been previously 
determined. For instance, when your CPU needs to 
perform a jump operation, the address of this jump was 
previously calculated. Otherwise, it could cause a process 
termination due to invalid memory access. For example, if 
you jump to an address in the data section, the process 
will attempt to execute something that is not executable. 
Fortunately, the protected mode of your CPU disallows 
this sort of thing. 


lf we could only use absolute addresses in our programs, 
all software would need to be compiled into a huge 
monolithic software image. In practice, real programs use 
tons of libraries. 


Libraries are a good example of relocatable code. The 
nice thing about this type of code is the possibility of 
re-using the same code in more than one software 
project. 


Relocatable codes use relative address, so when the 
linker/loader handle them, these relative address are 
adjusted to absolute addresses and then the code can 
execute in the target machine. 


Types of linking 


There are two types of linking or two different “linkage 
models’. The difference between them is related to the 
time that relocatable codes are resolved to absolute 
addresses. 
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The dynamic link adjusts the relocatable addresses 
before executing the software. It involves use of the 
dynamic loader from the operating system, usually called 
“Id”. 


The static link adjusts all relocatable addresses before 
generating the final executable file. It involves joining all 
codes (program and any libraries) into a single monolithic 
piece of software. 


software can mix the two types of linking. For example, a 
program can load at run-time a dynamic library. In this 
case, all relocatable codes are resolved on-the-fly during 
the dlopen() and disym() calls. 


In UNIX-like environments, roughly speaking, when you 
use libraries with a “.a” extension, you are dealing with 
static linking. Whereas, when you use libraries with a 
",so. extension, you are dealing with dynamic linking. 


How can be possible override a 
function? 


The technique used to accomplish this task depends on 
the linkage model used during the software building. 


In UNIX-like environments, for dynamic libraries, there is 
an environment variable that allows you override 
functions. This variable is called “LD PRELOAD”. 


When you pass to the LD_ PRELOAD some paths of 
shared libraries. Any library referenced in LD_- PRELOAD 
is loaded before any other library, including the libc. 


When the loader (Id) or even an explicit call to dlsym is 
done, the libraries searched at first will be those that are 
loaded. In this case, that would be the libraries referenced 
by LD_- PRELOAD. 


In the shared library where the function override is done, 
the way to find the original (overridden) function is by 
calling dlsym with a special handle. This handle is called 
RTLD NEXT. Usually, it is the value *-1". The 

RTLD_ NEXT instructs the dlsym function to look for the 
next symbol in the chain. So the original function will be 
found. 


Code Listing 1 shows a basic way of overriding the 
function fopen() from a shared library. The new fopen 
function will call printf with some information about the 
file, and then call the original fopen function. 


The compilation of Code Listing 1 can be done in the 
following way: 


gcc -Shared override.c -oliboverride.so 


The Code Listing 2 is the shell script that performs the 
function override using the LD_ PRELOAD technique. 
Basically, you wrap your run command with: 


LD: PRELOAD=<11St. Of .Libiraries> command 
<args> 


If you run a program using the shell script in Code Listing 
2, any fopen() call will be overridden by the function in 
Code Listing 1. As a result, you will see the data related 
with path and mode printed in your terminal screen. For 
example: 


s(/LONsen «7 your fopen Cest LileJExe 


The output generated by the command above would be 
something like: 


TAS; Wales = Eee eae 


mode = xr 


For static linking, the technique is almost the same for 
dynamic. However, since there is no LD_PRELOAD in the 
Static link context, we would need to recompile the 
software with the library that contains all function override 
stuff. 


Doing some useful stuff with these 
overrides 


In this section, | will show you parts of a library that | use 
for writing C unit tests in my spare time projects. This 
library has an additional feature related with memory leak 
detection. The way that leaks are detected is by using a 
function overriding with a static library, in this case, the 
own unit test library. | call this library “cutest”. 


Code Listing 1: Overriding the fopen function with a shared library. 


l J// File: override.c 
2 #include <stdio.h> 
4 #include <dlifcn .h> 


> #ifndef RTLDO NEXT 

6 # define RTLO NEXT -1 

7 #endif 

9 FILE «(«tru fopen)(const char «file path, 
ll void «handle = (void +«)RTLO NEXT; 


iS FILE «fopen(const char «file path, 
ld if (tru fopen == NULL) { 
15 tru fopen = 


16 } 
is if (tru fopen == NULL) { 


19 printf (" ERROR: _fopen_hook_not_done!\n" ); 


a» return NULL; 
21 } 


printf(" file path =_%s \nmode_=.%s\n" , 


return tru fopen(file path, mode); 


const char *«mode) = NULL; 


const char «mode) { 


(void «)disym(handle, “fopen”™ ); 


file path, mode); 


Code Listing 2: Preloading the generated shared library. 


| #!/usr/local/bin/ bash 


+ APP=$1 

| shift 

) ARG=$1 

6 LD PRELOAD=./liboverride .so SAPP SARG 
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The Code Listing 3 shows the basic layout of a unit test 
written using libcutest. The macros are merely 
abstractions of boring function definitions, thus, you can 
focus only in what matters: testing your stuff. The code of 
your test goes inside the sections delimited by 
“CUTE_TEST CASE(case_name)’ 
“CUTE_TEST CASE END”. Inside those sections, you 
can perform several types of assertions. The most basic 
is the “CUTE _ASSERT(<logic assertion>)’, when false it 
will abort the test execution. More details are outside the 
scope of this article. 


Once you build the unit test application, all that you 
should do ts run this application and watch for the exit 
code. Non-zero exit codes indicate errors and a zero 
code indicates that all tests were passed. 


A neat thing is that if you pass the option “--cutest-leak- 
check=yes’, the application will automatically start 
monitoring the memory allocations. At the end if there are 
some allocated data still not freed, this will be reported 
and the application will exit with a non-zero code. 


In other words, the library is capable of detecting memory 
leaks. Amemory leak can be pretty harmful if your 
application stays running for hours, days or even years. 
This kind of resource consumption can slow down the 
system and also affect other processes. 


Earlier detection (during unit test execution) could 
mitigate this kind of issue and also avoid disgusting 
remote debug sessions, crash dump analysis, etc. In the 
next sections, | will describe how | implemented the 
memory leak detection using simple function overrides. 


Code Listing 3: The basic layout of a unit test application. 


| #@include <cutest .h> 
4 jeyour includes goes here; 
> CUTE TEST CASE(case x) 


6 /*eyour test stuff goes here«/ 
unsigned long x mw OQ; 


s CUTE ASSERT(func x(&x) < O || x == Oxabc); 


9 CUTE TEST CASE END 


11 CUTE TEST CASE(case y) 

12 jeyour test stuff goes here«/ 
3 CUTE ASSERT(func y() = 1); 
id CUTE TEST CASE END 


i6 CUTE TEST CASE(tests runner ) 
17 CUTE RUN TEST(case x); 
1s CUTE RUN TEST(case y); 
\9 CUTE TEST CASE END 


21 CUTE MAIN(tests runner); 


Code Listing 4: The function overrides done by libcutest. 


| void init memory func ptr() { 
2 #ifdef WIN32 

3 tiens 

| #endif 


return: 


} 
0 #ifmdef WIN32 
void «handle = (void «)RTLO NEXT; 


Ll tru calloc = (void +)disym(handle, “calloc”™ ); 


12 tru. malloc = (void +)disym(handle, “malloc” ); 
13 tru free = (void «)disym(handle, “free” ); 

ld tru realloc = (void «)disym(handle, “realloc”™ ); 
5 g membhook init done = 1; 

li #else 

i7 fcc) 

is #endif 


ig” } 


if (tru calloc != NULL && tru malloc != NULL && 
6 tru realloc !m NULL && tru free !m NULL) | 


Overriding the basic memory handling 
functions 


Now that you already know the basics of function 
overriding will be easy to present to you the overrides 
done by libcutest. This action is performed inside the 
“cutest_memory.c”’ module. The overridden libc functions 
are: malloc(), calloc(), realloc() and free(). The Code 
Listing 4 shows the initialization function 
“init_memory_func_ptr()’; this function is responsible for 
overriding all relevant libc functions. In Code Listing 4, 
you will only see the code for UNIX-like systems, the 
Windows code was omitted. If you are interested in 
seeing how this works on Windows, you can clone the 
library repo and look at the source. 


Code Listing 5: The malloc’s override. 


| void «matlloc(size t size) { 

2 void «retval = NULL; 

5 if (tru malloc =— NULL) { 

| #if defined( WIN32) || defined({ FreeBSD) 
5 init memory func ptr(); 

6 #endif 


There is nothing new in Code Listing 4. The RTLD_ NEXT 
technique was used and the flag “g_ memhook_init_done” 
is a way of signaling that initialization function was called. 


Now let’s see the code for the overridden malloc in Code 
Listing 5. In this code there are some nullity checks in 
order to avoid null pointer access. However, the basic 
idea is to call the original malloc function and to register 
allocation if the leak system is currently activated (“-- 
cutest-leak-check=yes’). The pointer “g_ cute _mmap’ is 
simply a linked list that stores the initial address of the 
allocated memory and also the size of this allocation. 


The code of the calloc is almost the same as the code for 
malloc, except, of course, the original function call. In the 
case for calloc is tru_calloc. 


7 if (g membhook init done) | 

x cute log(" libcutest _INTERNAL_ERROR: null_tru matloc().\n" ); 
oF) } 

10 if (tru matloc == NULL) { 

1 return NULL; 

12 } 

13 } 

i4 retval = tru malloc( size ); 


5 if (g cute leak check) { 


6 g cute mmap = add allocation to cute mmap ctx(g cute mmap, size, 


\7 retval); 
Ls } 
19 return retval; 
‘N) } 
Code Listing 6: The realloc’s override. 
| void «realloc(void «ptr, size t size) { 
2 void «retval = NULL; 
3 if (tru realtloc == NULL) {| 
| #if defined( WIN32) || defined({ FreeBSD) 
5 init memory fume ptr():; 
6 #endif 
7 if (g memhook init done) { 
8 cute log(" libcutest .INTERNAL_ERROR: null_tru realloc().\n" ); 
‘j } 
LO if (teu reatloc == NULL) { 
1] return NULL; 
12 } 
13 } 
ld retval = tru realloc(ptr, size); 


15 if (g@ cute teak check) { 


16 g cute mmap = rm allocation from cute mmap ctx(g cute mmap, ptr); 
7 g cute mmap = add allocation to cute mmap ctx(g cute mmap, size, 


19 } 


2 return retval: 


retval); 


The realloc’s override before registering the allocation 
address take care of removing the possible previous 
allocation, since the realloc() function can change the 
original pointer address. The Code Listing 6 shows the 
realloc’s override. 


All pointers allocated by the functions malloc(), calloc() 
and realloc() should be released by the function free(). 
Thus, the free function’s override should take care of 
removing any allocation previously registered by these 
three functions (if the leak system is activated). Take a 
look in the Code Listing 7. 


How the leaks are detected at the end 
of the execution 


The overridden allocation functions are responsible for 
registering their allocations into a global list and the free() 
function is responsible for removing the related released 
allocation from this global list. Since you release all you 
have allocated at the end of the execution this global list 
must be equals to NULL or in other words empty. If the 
pointer representing the list's head is non-null a report 


Code Listing 7: The free’s override. 
| void free(void «ptr) { 
2 if (tru free == NULL) { 
+ #i1f defined( WIN32) defined( FreeBSD )} 
init memory func ptr(); 
> #endif 
6 if (g memhook init done) { 


based in the remaining allocations contained into this list 
is shown and the program exits with an error code. 


The code for detecting the presence of some memory 
leak is defined into the macro CUTE MAIN(). In Code 
Listing 8, you can see the snippet of this part of the code. 


sometimes to find a memory leak can 
become hard... 


| think that debugging should be the last resort. If your 
code is straightforward and clear, you can find a bug just 
by observing its behavior. 


lf for fixing up every single thing, you need a debugger it 
can be assumed as a code smell. 


Anyway in cases like that, for memory leaks, the libcutest 
also includes a feature. This feature will launch a 
SIGTRAP when a specific leak id is hit. 


A SIGTRAP is also known as a debug break. So if you 
are with the debugger attached in the process, it is 
possible to see the call stack and inspect the code more 


7 cute log(" libcutest .INTERNAL_ERROR: null_tru free().\m" ); 


} 
9 if (tru free == NULL) { 


LO return: 


L 


} 
13 if (g@ cute leak check) { 


l4 g cute mmap = rm allocation from cute mmap ctx(g cute mmap, ptr); 


5 
16 if (ptr == NULL) { 


l7 return: 


19 tru free( ptr); 


Code Listing &: The memory leak detection logic. 


; cute log memory leak(); 
| del cute mmap ctx(g cute mmap); 
: exit code = 1; 


one 
2 if (g cute teak check && g cute mmap != NULL) { 


deeply. Of course, we need to recompile the application 
with debug information (the GCC’s -g option gives you 
that). 


Maybe you are questioning about how you will know the 
“leak id”. Well, each memory leak report is numbered and 
you can see these data in the leak report. So you should 
use this value to cause a debug break exactly when that 
allocation occurs when you re-run the process. 


To cause a debug break at a particular leak id, it is 
necessary to run the unit test program with the option °-— 
cutest-leak-id=<id>" besides the *--cutest-leak- 
check=yes.. 


Code Listing 9 shows how this debugging feature is 
implemented in libcutest. The parts related with Windows 
were omitted. According to the Code Listing 9, the 
function call “raise(SIGTRAP)” triggers a debug break if 
the current allocation id is equal to the allocation id 
informed by the user via command line option. 


Some action with these overrides... 


For now on, | will show you how a function override can 
be useful instead of destructive. Code Listing 10 
introduces a tiny sample project called “greeting”, this 


project is composed of three files. All that the resulting 
program does is display a greeting to the user based on 
the passed command line argument. 


As you can see, the greeting function is kind of stupid 
because it allocates memory without needing it for doing 
the task. However, it was intentional. 


For compiling those listed files, you should proceed as 
follows: 


gcc greeting.c main.c -ogreeting 
Running the program is pretty straightforward: 
./greeting “john doe” 


The Code Listing 11 includes a unit test project, using 
libcutest. This is based on the project presented in Code 
Listing 10. 


Assuming that libcutest was pre-built inside a 
subdirectory called “cutest”, the compilation command in 
supported BSDs would be: 


OCG Leck Main.c “OCreSstino-Un1 Lt Greeting .0 
-Icutest/sre -Lcutest/lib -lcutest 
-lpthread -lexecinfo 


Code Listing 9: How a debug break is raised in libcutest. 


| struct cute mmap ctx + 


2 add allocation to cute mmap ctx(struct cute mmap ctx +mmap, 
void waddr) | 


3 size 
struct cute mmap ctx «head = NULL; 

5 $truct cute mmap ctx *«p = NULL; 

6 if (g cute last ref file == NULL) { 
return mmnap; 

8 } 

0 #ifmdef HAS NO PTHREAD 

lO pthread mutex lock(&mmap mutex ); 

ll #endif 

i? head = mmap; 

3 if (head == NULL) { 

ld new cute mmap ctx(head ); 


15 p = head; 

16 } else { 

17 p = get cute mmap ctx tail(mmap); 
is new cute mmap ctx(p—>next ); 

LY p = p-—>next; 

Ny) } 

2) p->id = ++ cute mmap id; 

22 p->size = size; 

23 p->addr = addr; 

24 if (p—>id = g_ cute leak id) { 


25 raise (SIGTRAP ); 
} 


#ifmdef HAS NO PTHREAD 


28 pthread mutex unlock(&mmap mutex); 
20 #endif 
w return head; 


: Se. 
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For executing the tests in the simplest way, you should == HUMMING Greeting func. Tests. .. 


run: 
Hello you!!! 
./greeting-unit 
—-- passed. 
It will produce the following output: 
xxx all tests passed. [1 test(s) ran] 
= PNA Creer Ing Pane Veto ss 4 
cutest INTERNAL ERROR: Memory leak(s) 


Hello you!!! detected! ! 

-- passed. Fae 

*** all tests passed. [1 test(s) ran] Id=1 Address=0x085A0020 
File=/root/src/override/test/unit/test mai 

Nice, all test passed. Now, let’s check for memory leaks n.c [The last check before leak was at 

by re-running the tests with the “--cutest-leak- line #7] < Hello you!!!.. > 14 byte(s). 


check=yes” option: 

Leak total: 14 byte(s). 
./greeting-unit --cutest-leak-check=yes 

<<< 


Now, the following output was produced: 


Code Listing 10: A tiny sample project compound by three files. 


1 f/f File: greeting .h 
#ifndef GREETING H 
#define GREETING H 1 


‘ids GS tO 


int greeting(const char «name); 


= 
+” - 


#endif 


~>-I 


9 // File: greeting.c 

\O #include “greeting .h” 

ll #include <stdlib.h> 

\2 #include <string .h> 

lS #include <stdio.h> 

l4 

\5 imt greeting(const char «name) { 


16 char «str @m NULL; 
\7 
1a if (mame == NULL) | 
19 return 1; 
x 
str = (char «) matioc(11 + strien (name)); 


be the ty te 


if (str == NULL) { 
return I; 


~ 
’ 


et 


I 
27 
28 sprintf(str,. “Hello %s!!!\n",. name); 
Pant 
w printfh("%es\n", ster); 
31 
32 return O; 
33 } 
+4 


$+ f// File: main.c 
 #include <stdio .h> 
17 #include “ greeting .h” 


a8 
39 int main(int argc, char «*argy) | 

10 if (argc = 1) {| 

i printf(" use; %s_<data>\n"., argv [0]); 
12 return 1; 

‘3 | 

14 return greeting (argv [1]); 
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As you can see, a memory leak was reported and just by 
looking at the data inside the memory it is possible to 
guess where this leak is occurring. However, let’s assume 
that you could not figure out where this leak is happening. 


In this case, we need to debug. The first thing to do is 
recompile the codes with debug information. The GCC °- 
g” option does the job. So: 


gcc -g greeting.c main.c -ogreeting 


occ ~G Lest lMelm.c =o¢dres ting-unie 
greeting.o -Icutest/sre -Lcutest/lib 
-lcutest -lpthread -lexecinfo 


Now, we need to re-run the tests with the debugger 
attached on it. The way of doing that with GDB Is as 


follows: 
gdb ./greeting-unit 


After loading the binary data, the GDB will present you an 
output like the this: 


GNU gdb (GDB) 7.11.1 
Copyright (C) 2016 Free Software 
Foundation, Inc. 


GNU GPL version 3 or later 
<Ntto?// Gnu.W0rd/ .censés/op lL. html> 


License GPLv3+: 


This is free software: you are free to 


change and redistribute it. 


There is NO WARRANTY, to the extent 
permitted by law. Type "show copying" 


and "show warranty" for details. 


Type “show contiguration” for 


Conrtiouration: details. 


For bug reporting instructions, please 


see: 
<http://www.gnu.org/software/gdb/bugs/>. 


Find the GDB manual and other 


documentation resources online at: 


<http://www.gnu.org/software/gdb/documenta 
[enlko) ay gear 


For help, type "help". 


Type "apropos word" to search for commands 


relatea tO. “word” « «. 


Reading symbols from 


./greeting-unit...done. 
(gdb) 


The most important information is “Reading symbols from 
./greeting-unit...done.” because it indicates that the debug 
information were loaded, thus your debug session will be 
more sane. 


To run the binary from inside the debugger is simple, all 
you should do is execute the command “run”. However, 
the binary needs the “--cutest-leak-check=yes’ option, in 
this case you should execute “run —-cutest-leak- 
check=yes.. 


After running it into GDB, the same leak report will be 
presented to you. Now we will re-run the unit test passing 
the leak id “1” in the following way: 


run --cutest-leak-check=yes --cutest-leak- 
Le. 


This time the GDB output will be: 


Code Listing 11: The unit test for the tiny sample project. 


test main.c 
<cutest .h> 
"../ greeting .h" 


l f// File: 
2 #include 
4 #include 


> CUTE TEST CASE( greeting func tests) 

6 CUTE ASSERT( greeting (NULL) != 0); 
7 CUTE ASSERT( greeting ("you") == 0); 
* CUTE TEST CASE END 


1) CUTE TEST CASE(test main) 
lL CUTE RUN TEST( greeting func 
\2 CUTE TEST CASE END 


tests); 


l4 CUTE MAIN(test main); 
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Starting program: 
/root/src/override/test/unit/greeting-unit 
--cutest-leak-check=yes --cutest-leak-id=1 


[Thread debugging using libthread db 
enabled] 


Using Dost, tipthread. cp Labrary 
UP lao La DEnt eed. CbscOsd.”< 


= eG: GLeeermnG LUNG: teol ocd « 


Program received signal SIGTRAP, 


Trace/breakpoint trap. 


Oxb7f£91le87 in raise () 
/lib/libpthread.so.0 


Eom 


(gdb) 


The message “Program received signal SIGTRAP, 
Trace/breakpoint trap.” indicates that a debug break has 
occurred, so the process is interrupted. We can then 
inspect the callstack using the command “bt”. This 
command will produce the following output: 


(gdb) bt 


#0 Oxb7f£91le87 in raise () from 


/lib/libpthread.so.0 


#1 Ox0804a20c in 


aq0d allocation TO Cuvee: mmap.cux {) 


#2 -OxOC04a52¢d. 1m malloc {) 


Code Listing 12 
ff File: 
2 #inctude 
3 #include 
| Winclude 
» #include 


Lhe erecting function 
greeting .c 

“greeting .h” 

<stdlib.h> 

<string .h> 

<stdio.h> 


int greeting(const char «name) { 
char «str = NULL; 


if (mame a NULL) | 


return Il: 


} 


str = (char +) matlioc(11l + strien (mame)); 


6 if (ste =< NULL) [ 
return Il: 


Ls I 


20) sprintf(str, “Hello %s!!!\n", name); 


printl( "Sala". ste); 


2 return O; 


Of 


#3 


W vou ) 


Ox0804a677 in greeting (name=0x804a810 
aL 


(TOOL /StC Over lide/test/gree ing.c:14 


#4 Ox08048e0c in greeting func tests () 
at 
VLOOL7 S11 C/OVer ide) Tesv/ Unt lest Maines 7 


#5 Ox08048ebc in test main () at 
/root/src/override/test/unit/test main.c:1 
1 


#6 Ox08049189 in main 
argv=Oxbfffef04) at 
/root/src/override/test/unit/test main.c:1 
4 


(argc=3, 


(gdb) 


Inspecting the presented callstack, we see that the last 
thing done in our code occurred in the function 
“greeting()’, at the line 14 in the file “greeting.c’. After 
that, things occur inside malloc() and it comes from 
libcutest, do you remember of 
“add_allocation_to cute _mmap_ctx()” function? Look it 
just after the top of the stack, but it is not relevant for us. 


Let's take a look in “greeting.c” in the Code Listing 12. 
The GDB is telling us that the last thing done inside our 
code before the debug break was at line 14. 


Well, according to Code Listing 12, line 14 is about a 
malloc() call. If you inspect the code, the “str” pointer is 
neither being returned nor freed. 


You have found the problem. Supposing you added a 
free(str) at end of the function. Thereafter, re-compile both 
the main project and the unit test project. When you 
re-run the unit-test with “--cutest-leak-check=yes’, no 
memory leak reports will be shown. This indicates that 
your code Is freeing everything that it allocates. 


Conclusion 


This text was intended show you the useful and 
constructive side of function overriding. When it was 
done, it presented a way of detecting memory leaks using 
my unit test library. 


Two main ways of performing function overrides from 
userspace were discussed. The first one is by using the 
LD PRELOAD environment variable. This technique is 
useful when you cannot re-compile the program. The 
second one technique Is the static way, and involves 
recompiling the software. The nice thing about a 
re-compile is portability, when do you need to use this 
technique in non-UNIX environments. 


However, in UNIX-like systems, the LD_ PRELOAD 
technique can also be used for detecting memory leaks in 
programs that you cannot re-compile. But in this case | 
personally prefer to use Valgrind 
(https://www.valgrind.org). When running my unit tests, 
usually, | like to use my memory leak system besides 
Valgrind. In this case, | can quarantine the problem as 
soon as possible and solve it while still in the building 
phase. 


Much more can be done with memory profiling and 
function overrides. As instance invalid accesses to 
memory can be detected if you override functions like 


“memcpy”, “memmove’, etc. Also string functions like 


“strncpy’, “strcpy”, “strcat” and so on. 


With LD- PRELOAD, it is also possible, for example, to 
add network proxy support to applications that do not 
offer this feature natively. The main idea for doing this 
task is override the main socket functions and of course, 
handle the proxy complications on your own. 


If you are interested in Knowing more about the unit test 
library used as sample in this text, you can download the 
source code at https://github.com/rafael-santiago/cutest. 
There you can also find instructions about how to build 
and use it. 


As you can see, function overrides are great and you can 
use them for several useful and non-destructive tasks. 


28 


About the Author 


Rafael Santiago de Souza Netto is a Computer 
Scientist from Brazil. His main areas of interest 
are Programming, Computer Networks, 
Operating Systems, UNIX culture, Compilers, 
Cryptography, Information Security, Social 
Coding. He has been working as Software 
Developer since 2000. You can find him at 
GitHub (as rafael-santiago). 


INTRODUCING THE TRUENAS® X10, THE MOST COST-EFFECTIVE ENTERPRISE 
STORAGE ARRAY ON THE MARKET. 


Perfectly suited for core-edge configurations and enterprise workloads such as backups, 
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Automating Vulnerability 
Scanning with Vuls 


In recent years, the number of cyber security incidents 
has been steadily increasing. The importance of security 
measures is widely recognized both by the general public 
and among experts. However, most of the successful 
attacks originate from only a few sources. According to 
the Verizon Data Breach Investigations Report (DBIR) 
2016, “The distribution is very similar to last year, with the 
top 10 vulnerabilities accounting for 85% of successful 
exploit traffic.” Despite the belief that most attacks are 
sudden and unpreventable, the attackers often use 
known vulnerabilities. So the application of existing 
security updates can easily prevent most successful 
attacks. 


However, it is not easy for system administrators to apply 
security updates in a timely manner. To avoid downtime in 
a production environment, it is common for a system 
administrator to choose not to use the automatic update 
option provided by the package manager, and instead to 
perform updates manually. This leads to the following 
problems: 


The system administrator will have to constantly watch 
out for any new vulnerabilities in the NVD (National 
Vulnerability Database) or similar databases. 


It might be impossible for the system administrator to 
monitor all the software if there are a large number of 
software packages installed on the server. 


It is time-consuming and onerous to determine the 
servers affected by new vulnerabilities. The possibility of 
overlooking an affected server is very real. 
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SECURITY 


As a result, security updates are often delayed, leading to 
security incidents. 


Consider a case where you actually deal with security 
updates. First, you check CVE (Common Vulnerabilities 
and Exposures, hitps://cve.mitre.org/ ) and NVD ( 
httos://nvd.nist.gov/ ) to collect vulnerability information. 
As an example, if you are dealing with CVE-2016-5636 
(which is one vulnerability of Python), you need to check 
the specific pages on the above websites for 
CVE-2016-5636: 


https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-201 
6-5636 


https://nvd.nist.gov/vuln/detail/CVE-2016-5636 
Next, log in to the server you wish to examine: 


S ssh user01@freebsd0l 


Then, in order to know whether or not there is an impact 
from this vulnerability, collect the information of the 
installed software: 


S pkg info python27 
PY ton l=Z. fei) 


Name : python27 

Version: & 2eJeLd 

Inestalibed on = Fra Mar 25° 02233739 201.6 
ULC 

Origin <= Jang pyenenZ7 

Architecture FreeBSD:10:amd64 

Prefix ¢ jusr/ local 


Categories : python lang ipv6 - Reports on a regular basis using CRON or other 
Licenses = ea: methods to manage vulnerability. 
Maintainer : python@FreeBSD.org 


Vuls Features 
WWW : http://www.python.org/ 


¢ Scan for any vulnerabilities on Linux/FreeBSD Server. 
Since this vulnerability affects Python before v2.7.12, we 


can conclude that this server is affected by this 
vulnerability. 


¢ Scan middleware that are not included in OS 
package management 


¢« Scan middleware, programming language libraries and 


As seen above, these manual operations require a great framework for vulnerability 


deal of labor. If you manage hundreds of servers, it is 


almost impossible to check all servers. In this article, we - Agentless architecture 
introduce open-source software that solves these 
problems. - User is required to only setup one machine that is 


connected to other target servers via SSH 


What's Vuls? 
« Nondestructive testing 
We will introduce you to Vuls, open-source vulnerability 


scanner for Linux/FreeBSD, agentless, and written in Go - Pre-authorization is not necessary before 


(https://github.com/future-architect/vuls). Vuls tells you scanning on AWS 

which servers and software are related to the newly 

disclosed vulnerabilities. Vuls uses multiple detection > Email and Slack notification is possible (supports 
methods including OVAL, Security Advisories, NVD, and Japanese language) 


changelog, and it is possible to scan many servers at high 
speed by using the parallel processing in Go language. It 
has the following characteristics. 


For details, refer to README 
(https://github.com/future-architect/vuls/blob/master/REA 


DME.md ) 
- Informs users of the vulnerabilities that are related to 
the system. Vuls Installation 
« Informs users of the servers that are affected. There are two ways to scan vulnerabilities in Vuls. 
- Detects vulnerabilities automatically to prevent any A. Scan via SSH Mode (Remote Scan Mode) 
oversight. B. Scan without SSH (Local Scan Mode) 


Without Vuls. With Vuls: 


Fetch 


NVD 
1. Get Security Update Daily ie IVN 
% - Notity > 
Lt slack ga * 


o Scan — — 
YS a 


2. Test / Apply 


! 
| 
| 
| 
! 
! 
| 
! 
| 
I 
| 
| 
| 
| 
| 
| 
! 
| 
! 
| 
| 
| 
| 
| 
| 
| 
l 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 


Figure 1. Vuls Motivation 
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Managed System 


Vuk f Ine 


tt f A 
~ @o | vr ; 
i = Ul 2 installed Softwares Vulmerability OG FN Ped 
et stated Packages ' i 
~ RSE aR Associate 4 Ovid 
: - Sett-Compded Scftwares — 4 * 
Gian 
Be ® errata 
fart. — _ 


F=|nangelog 


Figure 2. Vuls Abstract 


In this article, we will introduce mode A. Install Vuls on Full name: Vuls monitor user 
one server and connect to other servers from that server Uid (Leave empty for default): 


via SSH for scan. 
LOoGin Group [vuls |; 


LOGin-Group 21S Vuls. Invite vule into 
OLMer Groups? jl 

Login class [default]: 

Shell (sh csh tcsh git-shell nologin) 
[she csh 

Home directory [/home/vuls]: 

Home directory permissions (Leave empty 
for default): 

Use password-based authentication? [yes]: 
Use an empty password? (yes/no) [no]: 
Use a random password? (yes/no) [no]: 


Enter password: 


LO" aa ; Enter password again: 
Vals ‘a hock OUe The macCCcoun= a@ibter creation? ino] 

Username us 
Password - Senne 
Full Name : Vuls monitor user 

Figure 3. Vuls Use Case U1d : 1002 
Class 

As an example, we will setup one server for Vuls and Groups - vuls 

connect to localhost via SSH. We use FreeBSD 10.3. ene : Jarome) sale 


Home Mode 


Create Account 


Shell * J Ory oh 
Create a user account to run vuls. Locked > no 

OK? (yes/no): yes 
root@:~ # adduser adduser: INFO: Successfully added (vuls) 
Username: vuls to the user database. 


32 


Add another user? (yes/no): no 


Goodbye! 
Install requirements 
Install the required packages. 


root@:~ # pkg install go git sudo sglite3 
gmake 

rOOLCs*-F 60 — yuls 

S$ mkdir SHOME/go 


Add these lines into $HOME/.profile. 


S cat .profile 

2 ote 106 oe 

export GOPATH=SHOME/go 

export PATH=S$PATH: S$GOROOT/bin: SGOPATH/bin 


Set the OS environment variable to current shell. 
= = gororiite 
Configure SSH 


Vuls doesn't support SSH password authentication. So 
you have to use SSH key-based authentication. Create a 
keypair on the localhost, then append public key to 
authorized_keys on the remote host to be scanned 
(localhost, in this case). 


S ssh-keygen -t rsa -b 4096 


Copy ~/.ssh/id_rsa.pub to the clipboard. Paste from the 
clipboard to ~/.ssh/.authorized_keys. 


Ghmod. 100 “/assn 
cat ~/.ssh/id rsa.pub >> authorized keys 


chmod 644 authorized keys 


Vuls requires registering the scanner fingerprint in 
known_ hosts before scanning, so you have to log in in 
advance. In this case, connect to localhost via ssh. 


> Ssa Valse l27 2020.4 

The authenticity of host '127.0.0.1 
(I27.0.0.1)7 can't be established. 

ECDSA key fingerprint is 
SHA256:L/NR7/Uhg+Mnj 93 43qIGzrKitMVtlI5EnRLBb 
REFILARFOUC, 

No matching host key fingerprint found in 
DIN « 


Are you sure you want to continue 
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connecting (yes/no)? yes 

Warning: Permanently added '127.0.0.1' 
(ECDSA) to the list of known hosts. 
FreeBSD 10.3-RELEASE-p18 (GENERIC) #0: 


Pore wt MOeet 0 Ul. 2017 


Tue 


Welcome to FreeBSD! 
Deploy go-cve-dictionary 


go-cve-dictionary 


(https://github.com/kotakanbe/go-cve-dictionary ) is 
open-source software used by Vuls. 


go-cve-dictionary fetches vulnerability information from 
NVD and inserts them into SQLite3 or MySQL. 


Make directory for Vuls logs. 


root@:~ # mkdir /var/log/vuls 
root@:~ # chown vuls /var/log/vuls 
root@:~ # chmod 700 /var/log/vuls 


Install go-cve-dictonary. 


> medi =p 
SGOPATH/src/github.com/kotakanbe 

S cd SGOPATH/src/github.com/kotakanbe 

S git clone 
https://github.com/kotakanbe/go-cve-dictio 
Navy. giLe 

S cd go-cve-dictionary 


S gmake install 
The binary was built under $GOPATH/bin 


Fetch vulnerability data from NVD. It takes about 10 
minutes (on AWS). 


$ cd SHOME 
So fOr 2 ay. “Seq 2002  o(dare wz" or") = -de 
Go=CVvVe=dictionary teltennvd “years 517 «done 


© ie —ealh Cve.sglires 
Deploy Vuls 
Install Vuls. 


>» mkdir “=p 
SGOPATH/src/github.com/future-architect 
> od 
SGOPATH/src/github.com/future-architect 


> OLE clone 
https://github.com/future-architect/vuls.g 
Tne 

> ed vyuls 

S gmake install 


The binary was built under $GOPATH/bin 
Configure Vuls 
Create a config file(TOML format). 


$ cd $SHOME 
o (Cet Cone Loom. 


[servers] 


[servers.freebsd01 ] 


ighersue = UO Ol 

porte a 

user = "vuls" 

keyPath = "/home/vuls/.ssh/id rsa" 
Check Configuration 


Check config.toml and settings on the server before 
scanning 


> WULLS? COMEEGEeESE 


Pu eb? 02552064 INFO [localhost] 
Ve Ider ag, “COnme 166-5 
Pou, AZ 0035206) INFO [localhost] 


Detecting Server/Container OS... 


Pow 12° OO s 352-06] INE Or tLLoGa lino sic. | 

Detecting OS of servers... 

foul 200235209). NFO |[localhnoese] «ily 1) 

Detected: freebsd01: FreeBSD 

10.3-RELEASE-p19 

Peels. Ske Oto 5 Oe) INFO [Llocalnost | 

Detecting OS of containers... 

Poul hee SOS oe INFO [localhost] 

Checking dependendies... 

Pad: Ly 0502 So 209] INFO [localhost] 

Checking Sudo: SeETLINngs. ss 

Poul: Ay Ue Sse 09.) INFO [freebsd01] sudo 
No need 

Pott. eZ Ove oe Oo.) INFO [localhost] 


Scannable servers are below... 
freebsd0l 


Scan 
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Start scanning. 


SAT lee Gea fh 


Pkt 7 O:0-2 35 253'6.] INFO. [localhost Start 
scanning 

Polat! SEs OOS S Ss 3.6.) ENEO. [Loca Lest | 
Gontig:: ~heme/vuls/contig.tom | 

a ee OOS 53 ol ENEOr i kOCal nos | 

Vali Galina icOnrVG.s2.4 

Fld) “sl. WO ee oo Onl ENEO: i IcOCal NOS] 
Detecting Server/Container OS... 

Poa OO S523 6 INEO | GOCalnos | 
Detecting OS of servers... 

[ad WOOO 35237); UNO? i ocalnest || i713 
Detected: freebsd01: FreeBSD 
10.3-RELEASE-p19 

Posed ee eS oi ae] INFO localnos | 
Detecting OS of containers... 

ae: her O05) 5 r| INEO:: IplOGaul nose] 
Detecting Platforms... 

Lt: D> 00235249). INEO: I lecalnos et]: ly) 


freebsdOl is running on other 


Pong ae: Oe 3 ie Ao] INFO [localnost| 
Scanning vulnerabilities... 
Poa ake Os Sos] INFO: .bocalnos t.| 


Scanning vulnerable OS packages... 


One Line Summary 


freebsdO0l FreeBSD10.3-RELEASE-p19 22 
CVEsS 30 updatable packages 


Report 


Use the report subcommand to check the scan results. 
This result can be notified in several ways such as mail 
and Slack. 


View one-line summary: 


> Vuls, epork. =fermac=-Oone=line=—Erext 


—cvedb-path=SPWD/cve.sqlite3 


Redtard ce “OOS ee] INFO [localhost] 
Vadioua Gang i COnmEe 1G ence 
Fed ke "0 Oe SF sal INFO [localhost] 


cve-dictionary: /home/vuls/cve.sqlite3 
able AZ SOO 1: INEO: | bocalLnos te 
Loaded: 
/nome/vuls/results/2017-07-12T00:35:492Z 


One Line Summary 


freebsdO0l TOtals 22 (Hiohe 


i 


Medium:15 Low:0 ?:0) 30 updatable 


packages 


View short summary: 


> VULS. Tepore =—formlaLl=snorl_—text 
-cvedb-path=SPWD/cve.sgqlite3 --l 
Moue. da VOSse 2 OS] INFO [localho 
Validating: Contig. «4 

otic. 2 VOSS eS | INFO [localho 
cve-dictionary: /home/vuls/cve.s 
Pou, 12 VOSS sO] INFO [localho 
Loaded: 

(ome volsy resi s/7Z017=-07=-12700 


freebsd0Ol (FreeBSD10.3-RELEASE-p 


Total: 22 (High:7 Medium:15 Low: 
updatable packages 


CVE>Z0 16-3620 100 (High) 
overflow in the get data functio 


ZI PIMpOLrt. ©. an CPyEhnonm (aka. Pyth 


Zeteley, oer DELOLe: 24940, enc. ©. 


3.5.2 allows remote attackers 


ang=ja 
SC | 


st | 
qlite2 
st | 


Poo Ta O7 


Lo) 


0 220) 320 


IMCeger 

n in 

on) 

before 

Jax DEeLOre 


to have 


unspecified impact via a negative data 


size value, which triggers a 


heap-based 


buffer overflow. 


http://www.cvedetails.com/cve/CVE-2016-563 
6 


https://vuxml.tréeebsd.org/treebsd/ 1d0t6352 
-33d8-lle6-a6o7/1-60a44ce6887b. html 


DyenonZ)-2Z.7.i) 2 => pyehouZ 7-2. 7.135 6 


Confidence: 100 / PkgAuditMatch 


TUI 


Vuls has Terminal-Based User Interface to display the 
scan result (see Figure 4). 


5 Vals cas. 


lf you got the following error, try another terminal such as 
xterm. 


S Vis Tui 


[Wik LS Lot39s36)] LINO: TlLocalnGst | 
Vad ideal Uno: -COmt ls << 


EFRRO[OOQOO] termbox: error while reading 
terminfo data: termbox: unsupported 


terminal 


Figure 4. Terminal-Based User Interface 
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Figure 6. Make a list of CVE by Pivot Table 


Web UI 


VulsRepo (https://github.com/usiusi360/vulsrepo ) is a 
Web UI for Vuls (See Figures 5 and 6). 


Conclusions 


Using Vuls makes it possible for the system 
administrators to automatically detect vulnerable 
servers. Since the system administrators can only 
focus on vulnerabilities related to the system they 
manage, the burden is greatly reduced. As a result, 
the security updates can be applied continuously. We, 
developers want Vuls to make the world peaceful. 


ee 
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MINIXCon 2017 Announcement 


After the successful MIN|XCon 2016 in Amsterdam, the MINIXCon steering committee has decided to hold MINIXCon 2017 in Munich, 
Germany, on Sept. 18, 2017. The Chair of Operating System (Prof. Dr. Uwe Baumgarten) will be our patron from the Technical University 
Munich. The idea is to exchange ideas and experiences among MINIX 3 developers and users as well as discussing possible paths 
forward. Future developments will now be done like in any other volunteer-based open-source project. Increasing community involvement 
is a key issue here. We also will make a special effort to get industry involved. 


The videos of the MINIXCon 2016 talks can be found here . 
Date, Time, and Location 


Monday, 18 September 2017 from 09:00 to 18:00 at the Theresianum, Technical University of Munich. 


a 


@ 
Technische Universitat Minch... 8 sionin 
‘2 ArcisstraBe 21, 80333 Miinchen Save 
4.8 tock 231 reviews ee 
@ View larger map oy “8st, 
4 
3 
a 
Stej, 4 Technische @ Neue 
Nejy. > Universitat Munchen 
“Tr, We < ~ Maincam 68... 
ic Git 
& S) 
J 


S TUM Faculty 
” of Architecture 


Cro 
Strag 
‘ e@ 


Terms of Use 


___, Report a map error 


Giving a Talk 
The call for presentations is now open. To propose a talk, please see the Call for Proposals page: 


www.minix3.org/conference/201 7/cfp.html 


Registration 


To attend the conference, you need to register here. The early registration fee is 50 euro (20 euro for students) for registrations before 4 
Sept. 2017. After that, it is 75 euro for regular and 30 euro for students. This includes morning and afternoon coffee breaks, and lunch. The 
lunch will include a vegetarian option. 


Transportation 


You can fly to Munich Airport almost anywhere in the world. However, if you are coming from somewhere in Europe within 400 km of 
Munich, the train is probably faster and more convenient. 


Hotels 
Munich has over 400 hotels in a wide variety of price classes. Tripadvisor.com has ratings of almost 400 of them. 


Dont be afraid about the prices of the hotels. The Bavarian Beerfast starts on Saturday before the MinixCon2017. The hotel that is 
physically closest to the campus is Hotel Konigswache. You can get more affordable hotels reachable by subway (Stop Theresienstrasse, 
NO, not Theresienwiese!) If you plan to do some sightseeing in Munich before or after the conference, the Pinakotheken are reachable on 
foot and of course the Oktoberfest Another attraction are the Eisbach Surfers. 


Munich Tourism 


While MINIXCon 2017 is undoubtedly the biggest attraction in town, Munich has hundreds of things to do and places to see. Tripadvisor 
has a long list of Here are a few of the better-known ones. 


Marienplatz BMW museum ‘Town hall Deutsches museum Surfing the Eisbach wave 


Your Information Is Out 
There, Ready to Be Bought 


In today’s age, our presence on the Internet is just as real 
and important as our offline presence. From social media 
to email to online banking, our lives are intertwined with 
the Internet in some form of fashion. Those that use the 
Internet daily for work, school or pleasure know the 
dangers of viruses and pop-ups, but what about 
information? How did we become so okay with giving our 
information out to websites? Did they do something to 
earn our trust, that they deserve to know our home 
address, our phone numbers, pictures of our children, 
and everything that we do at every hour of the day? Even 
if you pay all your bills in cash, never sign up for an online 
account or never even open a web browser, websites still 
know you very well because they can share information 
with brick and mortar businesses. Most people don't tend 
to think about these things and just give websites or 
businesses everything that they ask for. MBA@QUNC 
explored whether people actually wanted to keep their 
data private and how much it meant to them. The results 
were from an Italian university’s research in which 
participants would sell their smartphone activity for as 
little as two euros. 
(https://onlinemba.unc.edu/blog/data-brokers-infographic/ 
) Now | Know | am going to start sounding paranoid and | 
will probably ask you to put on a tin foil hat if you continue 
reading. But bear in mind that this is not just speculation, 
it is backed up by facts. | encourage you to check my 
work and do your research before hopping on the crazy 
train. If you don't learn anything from this, at least know 
that all of this is supported by facts, and your information 
is out there ready for the best bidder. There is a popular 
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SECURITY 


saying concerning the internet, and it goes, “if you're not 
the customer, you're the product”. There are a few 
variations and a few people claim to be the original 
source. That aside, the meaning of this saying is that: 
companies need to make money to survive and they can 
make it in numerous ways. The obvious way is through 
directs sales, but with the increased use of the Internet, 
it's also possible for companies to make money through 
different means, particularly through the use of 
customers data. 


Google made 90 Billion dollars last year and they sell 
very few things. 
(https://www.google.com/finance?fstype=ii&q=NASDAQ: 
GOOG) Many services like Google make less money 
from physical items and more on either selling customer 
data or collecting, analyzing and using that data to make 
themselves money. Google, in particular, uses every 
search, email, location, picture and website you visit to 
help them build a complete profile of who you are and 
what things you like. They use this information to sell 
advertisement space to companies in places that you 
would most likely click on their advertisements. For 
instance, if you recently visited a travel agency website 
looking to book a trip to Jamaica, you may start seeing 
ads for similar trips on different websites. This is because 
Google is not limited to collecting data or presenting data 
on their site, any site that uses a Google product (ie. 
Google Analytics, Google Adwords, etc.) can be used to 
collect data on their behalf. 


(http://www.investopedia.com/stock-analysis/2012/what-d 
oes-qgoogle-actually-make-money-from-goog1121.aspx) 


There are several other services that do this, but besides 
Facebook and a few others, not on the massive scale or 
as well as Google does it. Most of the information Google 
collects is only used internally, but what about the 
companies that actively sell your information? 
(http://www.newsweek.com/secretive-world-selling-data-a 
bout-you-464/789) Well, there are way too many to list, but 
they all fall into some basic categories. The first being 
rewards programs from department stores, gas stations, 
grocery stores, etc. Yes, stores make money from making 
consumers believe that their rewards program will give 
them the cheapest deals. In reality, the prices are often 
marked up to make the discount seem bigger than it is, 
but that’s not the only reason they have these programs. 
They aren't giving you discounts because they are being 
nice, no, they use the information you give them to make 
more money. 


(http://dfw.cbslocal.com/2015/08/26/rewards-cards-how-m 


uch-personal-information-is-collected/) Why else would 
they need to know your full name, date of birth, address, 


email address and phone number? They make massive 
amounts of money off this information because the 
promise of free or discounted items makes any sane 
person sign up immediately. The collected information is 
also not treated as important as financial information and 
is often outsourced to be handled by a third party. 


(https://www.consumeraffairs.com/news04/2005/loyalty _c 
ards.html) 


Third parties are a major weak link in the data collection 
process as they do not always have to follow the same 
terms of service that the read and agreed to. If the first 
party company uses an unreliable or untrustworthy third 
party, your personal information could be exposed. Not 
only that, the more moving pieces and places your data is 
stored, the more probable it will be that your data is 
exposed or stolen. Businesses get hacked daily and if 
everyone in the data collection process doesnt use 
strong security, the weak link will be the first to be 
attacked. SOHA did a study showing that 63% of data 
breaches result from attacks on third party vendors. 


(http://go.soha.io/nubfs/Survey_Reports/Soha_ Systems 


Third Party Advisory Group 2016 IT Survey Report.p 
df) With enough resources, any business can be hacked, 


but if good security is used all throughout the process, we 
can make it much less likely. 


Data brokers have, perhaps, the most amount of 
information on individuals. There have been several 
stories covering this in the news, so | won't cover it too 
much in depth. Data brokers are the ones who sort most 
of the information that comes from online surveys, 
give-aways, credit companies, public records, warranty 
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registrations, bankruptcy reports, etc. 


(http://www.npr.org/sections/alltechconsidered/2016/07/11 


/485571291/firms-are-buying-sharing-your-online-info-wh 
at-can-you-do-about-it) They are not limited to where they 


get their information and it can often get creepy, such as 
TLO and their license plate readers. 
(http://www.tlo.com/vehicle-sightings) These data brokers 
use this information to put you into a category and sell 
your information in very specific lists based on criteria 
such as age, gender, ethnicity, income level or medical 
history. 
(https://www.consumer.ftc.gov/blog/ftc-report-examines-d 
ata-brokers) 


Websites know way more than you think just by collecting 
metadata such as user agent string, IP address, browser 
extensions, etc. In a process known as browser 
fingerprinting, your browser can be uniquely identified to 
be your browser. Even if you are accessing the site from 
a different location, if you are using the same browser, 
they still know it's you. This coupled with your home IP 
address, websites can determine who in your household 
visits their site, how often, and if they are vulnerable to 
online advertisements. How is this accomplished? The 
programs installed on your computer have a lot more 
access than they should and this is not limited to 
browsers. This includes access to your location, operating 
system version, CPU information, battery information, 
screen size and color depth, touch screen support, 
network addresses including your local IP and its subnet, 
gyroscope, installed fonts and more. Coupled with your 
browser version, settings, installed plugins and 
extensions, language, etc., a very accurate fingerprint can 
be made of your browser that is unique from every other 
web browser in the world. Even if you are using a VPN, a 
capable website can easily identify your online activities 
and distinguish you from other users. 


(http://webkay.robinlinus.com/ , 
https://panopticlick.eff.org/) 


Social media is a completely different topic and can be 
almost entirely avoided by not using it, as long as no one 
in your family uses social media. With social media 
platforms such as Twitter, Facebook, Instagram, 
Snapchat, we freely give them all our information with 
very few questions asked. We do this to show our status 
in life, boost our self-confidence and to connect with 
friends and family, which we could do in person or over 
the phone just as easy. However, we're not going to focus 
on the human element of social media. We will focus on 
the large amount of data that social media can collect 
about you. With the use of third party cookies, extensions 
and social media scripts such as Facebook's like button, 


social media sites can track your web browsing history 
while you are logged into their services and even when 
you re not logged in. 


(http://www.huffingtonpost.com/nate-hanson/how-to-stop-f 
acebook-from_b_8160400.html) 


Facebook, by itself, knows too much about its users to be 
comfortable. Facebook can determine sexual preference, 
your exact GPS location (as accurate as the room in your 
building), number of credit lines, brand of clothing your 
household buys, medications, when you are likely to 
move, etc. The list goes on and on with its endless 
amount of creepiness. 


(https://www.washingtonpost.com/news/the-intersect/wp/2 
016/08/19/98-personal-data-points-that-facebook-uses-to- 


target-ads-to-you/?tid=sm_tw) Facebook also operates 
one of the most accurate facial recognition software in the 


world, which unsurprisingly is more accurate than what 
the United States FBI uses. Facebook correctly identifies 
photos 98% of the time while the FBI is only accurate 
85% of the time. This is, of course, due to their very large 
sample size of 1.28 billion active users. The FBI is much 
more limited in their sample size, so it makes sense that 
they do not get the same success rate. 


(http://www.npr.org/sections/alltechconsidered/2016/05/18 


/47781961/7/facebooks-facial-recognition-software-is-diffe 
rent-from-the-fbis-heres-why) This is just for Facebook; 


other social media platforms can figure out similar things 
about you as well. It should be noted that even if you 
have never had a social media account, your family 
members can violate your privacy pretty easily with their 
accounts. For instance, if Dave’s spouse posts about a 
vacation they are going on with Dave and the kids, it’s 
safe to assume Facebook will know that someone named 
Dave is going on vacation with the kids. 


Sometimes even your own government will sell your 
information. In the United States, many Division of Motor 
Vehicles (DMV)’s make millions from selling your personal 
information. This includes your name, address, birth date, 
emergency contacts, etc. 


(http://www.wkbw.com/news/nys-dmv-made-60-million-sel 


ling-drivers-personal-information) | witnessed this 
first-hand when | moved and had to get a new driver's 


license. | provided a lot of personal information to the very 
nice and sincere woman who helped me get my driver's 
license, not expecting all that information to become 
public. A few weeks later the same personal information | 
gave to the USDMV was posted on Whitepages premium 
for all to see. Sometimes the local government doesn't 
want money in return, they want more data in exchange 
for the data they have in the case of Waze, Moovit and 
Strava in cities like Rio. 
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(https://www.forbes.com/sites/parmyolson/2014/07/07/wh 
y-google-waze-helps-local-governments-track-its-users/) 


The big question is: why? Why do companies care what | 
do throughout my day? Why do they collect this massive 
amount of data on everyone? Like a lot of things, the 
answer comes down to money. Big data is such a 
profitable venture that many companies specialize in the 
field and make tons of money from it. There are two key 
issues | find with big data collection: the first being | like to 
live a private life and | do not enjoy my information being 
publicly posted on the Internet free for hackers, 
scammers, and telemarketers to take advantage of; the 
second being the collection and storage process of my 
personal information through a third party who doesn't 
care about the security of my personal information. You 
may not care where your personal information is being 
stored or how it’s being used, but consider this: there is 
only one of you that lives at your address, that has your 
birthday and that likes the same things you do. If you 
become a target by an individual, a group, a government 
or whoever, you will be compromised. That could come in 
the form of character defamation, slander, death threats, 
job loss, identity fraud or identity theft. Some things are 
harder to overcome than others and it’s better to be safe 
than sorry. In the case of identity theft, it could cost you a 
lot of time and money to repair the destruction to your life. 


Now if you're like me, you are paranoid all of the time and 
you don't give any information to anyone that doesn’t 
explicitly need it. |am not saying you need to live under a 
rock to have your private life stay private. What | am 
saying is before you give information to a large company, 
question if they really need it. If they don't need it, then in 
most places, it’s not illegal to feed them fake information 
and still enjoy the benefits of their service. It’s also not 
illegal to have multiple phone numbers or email 
addresses to give out so you are not tied to one specific 
identity. You could also go overboard with this and 
populate a ton of fake information into these companies 
to drown out the truthful information. It all depends on 
how far you want to go and how much time you have to 
waste. | will warn you to exercise caution when providing 
fake information to anyone. First ask yourself this 
question: is it illegal if | provide fake information to this 
individual/business/government? If you do not know the 
answer, do not provide fake information. It's better to stay 
out of trouble than to keep your privacy. 


Gone are the days where a private life was possible by 
default. To achieve the same privacy before the Internet, 


we must work much harder for it. The amount of work can 


be very different depending on your situation. | have not 
even touched on the massive amount of ways your 
personal information is collected, nor would | be able to in 
anything smaller than a dictionary, but | hope to have 
given you a small taste. | hope it encourages you to step 
out of the predefined box that online advertising and 
marketing have put you in and reclaim your privacy. 
These companies are not paying you anything, so why 
should they be making money off your data? Besides the 
fact, what happens when one of these companies gets 
hacked and all your personal information is posted all 
over the Internet? You may not think of where your 
personal information is very often and you may not care, 
but after reading this article | hope you at least 
understand a little about the industry behind selling [you]. 
Be proactive, not reactive with the security of your 
personal information and you won't have a chance to 
regret it. 
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Processing Data in Parallel Using 


Multithreading 


Real life being what it is, despite the isolation 
provided by the partitioned stack, a situation may 
still arise, where we might need to prevent more 
than one thread from executing a given function, 
or another block of code. For instance, we may 
be in the process of assembling a linked list, and 
it would be counter-productive to have two 
threads adding an element to the end of the list at 
the same time. 


To cater for such eventualities, the thread library comes 
equipped with a useful gadget called a Mutex -—which is 
an abbreviation for ‘mutually exclusive switch’. 


The above notwithstanding, a useful rule-of-thumb is: if 
you need to use a Mutex, you've done it wrong. The risks 
associated with adding a Mutex, which are outlined 
below, together with the fact that a Mutex negates any 
advantage of multi-threading, make its use highly 
undesirable. 


We declare Mutexes globally since, for obvious reasons, 
they need to be thread-visible. 


PLALreacd._mMuLex tL xmuvex; 


Thereafter, we have to put in some code to lock the 
Mutex, which warrants a more detailed discussion. 


The whole question of Mutex protection is analogous to 
that of file locking. Everything has to be done by 
agreement, and all parties wishing to access the resource 
have to cooperate. Accordingly, the correct way to do this, 
is as follows: 


° As early as possible, initialise and unlock the 
Mutex 
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UNIX 


° Just before the protected block of code, attempt to 
lock the Mutex 


° lf this fails, it means that another thread got there 
first, so sleep and retry until it succeeds 


° If it succeeds, lock the Mutex and execute the 
block of code 


° Just after the protected block of code, unlock the 
Mutex. 


This model makes several assumptions: 


° It is impossible for two threads to lock the Mutex 
simultaneously. 


° It is impossible for two threads to fail to lock the 
Mutex simultaneously. 


These assumptions are correct in 99.999% of cases. 
There are cases when they are incorrect, a condition 
known as ‘thread deadlock’. 


We initialise a Mutex to the unlocked condition, using the 
mutex init function: 


pthread mutex init(pthread mutex t *mutex, 
Penread Mutexattr © “~atur) 77 


The variable ‘attr is a pointer to an attribute structure, 
which contains one member, which is a pointer to an int. 
Since we are not interested in changing this, let us pass 
in NULL, to get the default Mutex conditions. 


ee ene NULL) 


printf (“Failed to initialise 
muTex< ni”)? 


} 


We now have an initialised Mutex, and can protect our 
precious code. There are two calls available to do this. 
We can either 


° Explicitly attempt to lock it, and check the return 
value: 
ie (pLntead ‘murex OCk(Gxmuvex) ==> =.) 4 


printf (“Failed to lock mutex\n”); 


° We can call a function which does this for us: 


LE(peA reac: mutex Cry Lock (Gxmutex) t= =i) 4 


Print’ (“railed tor lock murvex \n") y 
} 


lf we want to wait for the code to become available, we 
will need a loop, which we traverse, just before the block 
of code: 


while (pthread mutex trylock (&mutex) 
ce = 


sleep (1); 
j 


Then, at the end of our protected block of code, we add 
the following lines of code: 


if (mutex unlock (&xmutex) S14 


printf (“Failed to unlock mutex\n”); 


} 


Now were ready to try it. using our example code, above. 


We will add a Mutex to the code, to force the threads to 
execute it in their order of arrival. 


As it happens, this will not affect the overall timing, since 
the operation performed by each thread is sleep(). 
However, this generalisation does not apply to other 
functions. If we were performing real computationally 
intensive tasks, in our function, the advantages of 
multi-threading would be totally negated, as the threads 
would have to queue up to execute the function. 


 givigted olel=ae Goce hie meee 
#include <ctype.h> 
#include <pthread.h> 
#define | REENTRANT 
WOO: ees, (37-1 cee 


pthread mutex t mutex; 
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main(argc, argv) fe Main. **/ 
inehec vel Oey 

Citaie “a row. 

{ 

Pehteaa fy tar Loo, 

int delay; 

al ee game la 


Toe Vane GG. 4 


delay = 10; 
ib Jekse. 4 
delay = atoi(argv[1]); 


} 


Lie (pthread mutex anit (emutex, NUL) 
ae) 


DrintEe( Parle CoO -1laleraluse 
mucex\n”) > 


for(i = 0; i < 100; i++) { 


iE (Ol Meead eheale (etait (any 
(void *)&delay)) != 0){ 


NU Eis 
EUKS, 


printf (“Failed to create 


for(i = 0; i < 100; i++) { 


0) { if (pthread join(thr (i), NULL) 2= 


Chesca \ne 


} 


eae ances EO: Star tc 
rt), 


} 

PrInet All threads <cermimared 1”); 
} 7* Tain */7 
VOU: 


pp cderey) f* Func 


void *delay; 


{ 


ee ee ee 


sleep (1); 


printf (“Starting thread *d for «d 
Sexs«u Wi"; Deliecad Sell(); “(ime ~) delay); 


sleep (* (int *)delay) ; 


printf (“Thread @d returning..\n”, 
PUlseaC sel); 


ge ee eee a 


Printer (“Can't unlock mutex \n”"); 


} pe Bie. 7 


Performance Note 


So, we experience the trouble of parallelising our 
application, we create a hundred threads, with no 
Mutexes, and sit back and watch it run. 


Since we have one hundred parallel paths of execution, 
our process will run one hundred times faster, right? 


The answer is, yes it will, but our application probably will 
not.. 


The process, within its process slot, will certainly run one 
hundred times faster, but that’s not the whole story. The 
next question we should ask is, ‘How often does the 
process run?’ 


lf our process is the only one on the machine, then the 
application will certainly complete its operations at a 
considerably faster rate. However, in reality, we will be 
competing for CPU time with several dozen of other 
processes, and will have to take turns at running. 


lf our one hundred threads were one hundred processes, 
the overall application would, indeed, run nearly one 100 

times faster. If our application is performance critical, then 
there is no choice, but to do it that way. 


However, performance is not always the sole criterion. 
We should be concerned with the architectural elegance, 
or overall simplicity as well. 


There are many situations, where each thread must read 
and write global data within the parent process. The 
overhead of synchronising communication with many 
children, and shunting data back and forth, may not be 
worth the improvement in performance. 


Additionally, there may be computational reasons for 
using multi-threading, simply because we need to perform 
some operations in parallel. The simple case, where we 


leave the main thread listening for the next connection, 
while subsidiary threads handle each current connection 
is a good example of a threaded server. 
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Conventions over Restrictions - Programming the 
Python Way 


Python is a powerful programming language. It supports procedural and object-oriented 
programming, and provides important features for functional programming. Its dynamic typing 
and many meta-programming features allow doing nearly everything at run time. While this 
freedom provides lots of opportunities for elegant solutions, Python might also be perceived as 
a dangerously unrestricted language. The common solution is to use conventions to solve a 
problem in the preferred, hence, “pythonic” way. Experienced Python programmers tend to 
stick to these conventions as much as possible and only diverge when the benefits are 
substantial compared to that of the conventional solution. 

This article gives a short overview of Python features focusing on conventions and their 
benefits. Since Python syntax is often called executable pseudo code, a reader with solid 
programming experience does not need to have previous knowledge of Python to follow 


along. 
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INTERVIEW 


Interview with David Mytton 


History 


David Mytton was looking for a simple way to get metrics and alerts from his servers. He did not 
need a large enterprise product, and did not want to deal with legacy on-premise technologies. 
There was no product that fit the bill, so with the help of his school-friend, Harry, they decided to 
build their own. 


In Short 


David Mytton has been programming in Python and PHP for over 10 years, it was one of the 
earliest production MongoDB users (founding the London MongoDB User Group) He 
co-founded the Open Rights Group and can often be found cycling in London or drinking tea in 
Japan. 


46 


Can you tell our readers about yourself and your role 
nowadays? 


I’m the Co-Founder & CEO at Server Density. Having built 
the original version of the product, | used to do a lot of 
coding but nowadays, | spend most of my time with the 
overall management of the business in financial planning, 
oroduct strategy, technical and architectural oversight, 
commercial engagement with prospects and customers, 
hiring, PR & marketing and board or investor relations. 


How did you get into programming? 


| bought a book on ASP when | was thirteen and learned 
by building an e-commerce website for a local business. 
| moved onto PHP which allowed me to venture in web 
development appropriately. Starting Server Density was 
originally a project to learn Python since it’s the main 
programming language we use at the company. 


While having a wide field of expertise, which area do 
you emphasis on, and why? 


My role is quite varied so there is no real emphasis on one 
thing. The two things | spend most of my time on are the 
product and the commercial side of the business. 


With the product, we’re up against some very 
well-funded competitors whereas, we fund ourselves 
therefore, most of our growth comes from customer 
revenue hence, we have to make tough decisions about 
what we build and when. 


The commercial aspect of the business is tricky because, 
we have to be very disciplined in where we spend and 
who we hire. Server Density is mostly self service sales via 
credit card but, we are seeing majority of the customers 
asking for demos and a proper sales process. 


Thus, we've been developing our approach to this and 
have even started hiring real sales people! 


Being the founder of Server Density Limited, what was 
its inspiration? What was its purpose? 


Back in 2009 | was working with another business and 
got frustrated at the lack of quality products to help us get 
alerts and graphs for our own server monitoring (the open 
source options like Nagios took too much time to 
configure and require a lot of effort to maintain and scale). 


There was no service | could just buy and have it all work 
out of the box, so | decided to build it. 
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Who are your target group? 


We have over 700 customers with the largest group (85%) from the US and only 15% from UK where we are based. 
These include the UK NHS Ambulance emergency response service, eCommerce stores such as Firebox through to 
Silicon Valley startups. Engineers are our usual users - anyone who has a server to manage or website to monitor the 
uptime of can use Server Density. 


What was the most difficult and challenging implementation you’ve done so far? Please explain? 


The biggest thing we did recently was to completely rebuild our time series data storage backend. Since the old 

custom system based on MongoDB had grown with us for 7 years but, was beginning to cost a lot in terms of money for 
infrastructure and time for maintenance. Therefore, we swapped it out for OpenTSB running on top of Google Cloud 
Bigtable. This gave us linear scalability of throughput and cost. 


The challenges were to replace an existing system with a new database and also new schema on a new host provider 
with no downtime and migrate many TB of data without customer impact. And we did it! 


What tools should be used oftenly and what for? 


We’re migrating all of our infrastructure over to Google Cloud and are making use of Kubernetes (running on Container 
Engine) and Terraform. Our existing infrastructure uses micro services but not containers, so we’re taking the opportunity 
to containerize everything. Simply because, these tools are allowing us to fully automate and template our entire 
infrastructure - nothing is being done manually! 


Do you have any specific goals for the rest of this year? 


We have a few upcoming releases which will be taking advantage of some of the machine learning technologies available 
to us through Google Cloud. Al and machine learning are basically buzzwords at this point, so they have very little 
meaning for most people. Customers need not to worry that a product is using “machine learning” - it should be about 
the outcomes achieved with the technology, not technology just for technology’s sake! We have eight years of 
monitoring and alerting data and soon we have some interesting things coming from that . 


What’s the best advice you can give to programmers? 


Learn about infrastructure and how to run your apps. Any developer working in a modern organisation should currently 
be able to run their applications, not just pass it over to some separate ops team. This means monitoring, deployment, 
builds, testing, all under your control. Infrastructure technology is moving very fast and is fascinating to work with. 


The problem with this is getting into the on-call mindset. You should be expected to be responsible for running your 
code in production but that does not mean you should sacrifice your quality of life. 


Last year, we started a community called HumanOps to encourage discussion about this topic. Things like designing 
on-call rotas, understanding stress and introducing empathy into communications. Humans are an important part of any 
system and they are too easily forgotten. Check out http://www.humanops.com as there may be a meetup near you!. 


Thank you 
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FREE READING 
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Using Python Fabric 
to AGNU/Linux Server 


Configuration Tasks 


What you will learn... 
In this article, we will run through the basics of using Fabric to run local and remote commands 
and transfer files between servers. Through some examples, we will try to show some of its 
capabilities and use cases. 


What you should know... 
You are not required to have any prior experience to follow this article. However, if you are 
used to performing SSH system administration or application deployment tasks, it will be easier 
to realize some practical use cases. 


About the author... 

Renato Candido is a free (as in freedom) {software, hardware, and culture} enthusiast, who 
works as a technology consultant at Liria Technology, Brazil. He tries to solve technical’s 
problems using these sorts of tools (he thinks the world would be a little better if all resources 
were free, as in freedom). He is an electronics engineer and enjoys learning things related to 
Signal processing and computer science (and he thinks that there will be self-driving cars and 
speaking robots designed exclusively with free resources). Contact the author on 
http: //www.renatocandido.or 
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The recent tragedy and fire at Grenfell Tower in London 
that claimed more than 80 lives may seem as far from IT 
and technology as it is possible to imagine. But to the 
engineering mind, tt highlights the ongoing spectre of 
systemic failure and risk, where cascading error 
culminates in a disaster. 


authored by Rob Somerville 


It might seem insensitive at this early stage to equate one of the most devastating events to occur on British soil for 
decades with the cold hard reality and unforgiveness of complex systems, but | believe the IT industry and other sectors 
heavily dependent on technology, unlike the custodians and guardians of Grenfell Towers, have not ignored the many 
Cassandra like voices that have attempted to raise the alarm. In the case of Grenfell Towers, the residents repeatedly 
raised concerns about fire safety and the competency of the management group prior to the inferno. Indeed, the whole 
issue of the safety and viability of tower blocks in the UK has been an open secret amongst journalists, researchers, 
building engineers and many others for decades. For those with the eyes to see, it was only a matter of time. 


When | first heard the news, | had that horrible sinking feeling in my guts, not least because of the scale of what 
happened, but because it was clear that for such a hellish event to have occurred, multiple dominoes would have to 
have fallen. Concrete doesn’t burn. Tower blocks are inherently safe, provided you stick to the rules. And that includes 
understanding the engineering and scientific principles that the original (Hopefully competent designer) built the building 
or indeed the system upon. 


Once you turn your back on these, you have ventured in the gambling territory. You might make a fortune, or you could 
find yourself in an ever increasing spiral of pain. Reality has a nasty habit of sneaking up behind you when hubris, over 
confidence and arrogance, takes root. Irrespective if you are a human, a cultural and political system or indeed a robot. 


All it needs is for an over-abundance of trust for cracks to show. Like a deadly virus, the original trojan horse, this rot 
manifests itself as complacency, a complicity in a group think that everything will be OK provided we have a bit of paper 
and a box ticked. Ultimately, so much of the tragedy of life will be subscribed to human failure, as the universe works 
quite well without us. Technology and engineering is one of the greatest blessings bestowed on man, and as such, we 
need to devote to it respect rather than worship and thereby be seduced by the political and financial baggage that 
accompanies such power. 


Good engineers, like good technologists and IT folk, are like magicians, conjuring something out of nothing. All we ask 
for is resource, and we can do the seemingly impossible. Yet the system failed regardless. In the face of Grenfell, we are 
akin to hired guns, those that sell our souls to the highest bidder, willing to say or do anything just for some cash. By 
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refusing to confront bad design decisions or poor policy, take a moral stance and say no, we may protect our careers 
and wallets but expose our bad conscience. We have become a part of the problem rather than the solution. 


From a human level, both sides — the engineers, the creatives and senior management - live in very different worlds with 
very different perspectives and goals. So often there is an impasse, as neither side either wishes to, or actually can, 
understand. There is a connection though between the lofty heights of the plush executive boardroom and the dull gray 
work cubes in the trenches. 


That connection is fear. Planet X, financial collapse, death, whatever. There is a tacit acceptance not to approach the 
elephant in the room as merely mentioning him brings with it the chance of a stampede. If you do mention it, censure, 
ridicule, and accusations of your professional competence or sanity are raised - if not to your face, behind your back. 
Both sides refuse to speak the truth, as the consequences are too much to bear. We can’t fix the system properly as we 
grew too much, didn’t invest when we should have. We didn’t argue the risks hard enough. It takes a brave man or 
woman to openly declare the nakedness of the emperor. 


| don’t have an axe to grind, | see both sides. I’d just rather be in the trenches, coding all the time. Life has taught me 
otherwise. You need to walk barefoot amongst the fiery coals of the decision makers to truly understand the complexity 
and scale of the problem, not just of the technological system but the human one as well. 


Once you get into the arena of risk management, your integrity and indeed your soul are on the line. Paper may cover the 
cracks, but lawsuits from the relatives of dead people delivered through your letterbox are a different matter. Those with 
such responsibilities tend to be the serious folk. They may even admit in their quieter moments that they too are scared. 
Sometimes, they are just there as a token gesture to pretend everything is OK. 


We need to work together. Be totally honest, on both sides. If not, the battle between those with understanding and 
power will continue in ever decreasing circles until the arguments over policy, strategy and who is right ceases. By then, 
it will be too late. 


You are responsible. Your code is important. What is more serious though, is your rigor in terms of ethical and moral 
adversity. Would lives depend on this? Livelihoods? What effect will this have on the next generation? Will you say No? 
Put your career on it? Whistle-blow? 


In light of what happened on the yin of June, we need a reality check, at all levels. 


This article is dedicated to all at Grenfell in the hope that such devastation may never occur ever again, and that the 
truth, like sunlight, be found to be the best disinfectant. 
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Download syslog-ng Premium Edition 
product evaluation here 


Attend to a free logging tech webinar here 


BalaBit 


IT Security 


www.balabit.com 


syslog-ng log server 


The world’s first High-Speed Reliable Logging™ technology 


HIGH-SPEED RELIABLE LOGGING 


m above 500 000 messages per second 


= zero message loss due to the 
Reliable Log Transfer Protocol™ 


= trusted log transfer and storage — 
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FUNCTIONS: 


® Cures Windows workstations and servers. 
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* Verifies the quality of the anti-virus software currently in use 


FEATURES: 
s Dr.Web Curelt! doesn't require installation and doesn’t conflict with any known anti-virus; conse 


quently there is no need to disable the anti-virus currently in use to check a system with Dr.Web Curelt!. 


mproved self-protection and an enhanced mode for more efficient countermeasures against 
Windows bDiockers. 
s Dr.Web Curelt! is updated at least once an hour. 


s The utility can be launched from removable media including USB storage devices. 
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